-- Logs begin at Mon 2022-01-17 01:54:16 UTC, end at Mon 2022-01-17 03:01:13 UTC. -- Jan 17 02:26:15.347924 dv-cinder-821602-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 17 02:26:15.358033 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 17 02:26:15 2022] *** Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: nodename: dv-cinder-821602-13-iscsi Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: machine: x86_64 Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: clock source: unix Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: pcre jit disabled Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: detected number of CPU cores: 4 Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: current working directory: / Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: detected binary path: /usr/bin/uwsgi-core Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: your processes number limit is 47680 Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: your memory page size is 4096 bytes Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: detected max file descriptor number: 2048 Jan 17 02:26:15.359496 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: lock engine: pthread robust mutexes Jan 17 02:26:15.360443 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: thunder lock: enabled Jan 17 02:26:15.360443 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 17 02:26:15.360443 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 17 02:26:15.404406 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: Python main interpreter initialized at 0x55f3665589c0 Jan 17 02:26:15.404406 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: python threads support enabled Jan 17 02:26:15.404406 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: your server socket listen backlog is limited to 100 connections Jan 17 02:26:15.404406 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: your mercy for graceful operations on workers is 90 seconds Jan 17 02:26:15.404738 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: mapped 403077 bytes (393 KB) for 2 cores Jan 17 02:26:15.404825 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: *** Operational MODE: preforking *** Jan 17 02:26:15.405058 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: *** uWSGI is running in multiple interpreter mode *** Jan 17 02:26:15.405058 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: spawned uWSGI master process (pid: 101930) Jan 17 02:26:15.405257 dv-cinder-821602-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 17 02:26:15.406722 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: spawned uWSGI worker 1 (pid: 101931, cores: 1) Jan 17 02:26:15.406722 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: spawned uWSGI worker 2 (pid: 101932, cores: 1) Jan 17 02:26:15.406722 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 17 02:26:17.202747 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:26:17.202747 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: from cryptography.utils import int_from_bytes Jan 17 02:26:17.203446 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:26:17.203446 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: from cryptography.utils import int_from_bytes Jan 17 02:26:17.206222 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:26:17.206222 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: from cryptography.utils import int_from_bytes Jan 17 02:26:17.206739 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:26:17.206739 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: from cryptography.utils import int_from_bytes Jan 17 02:26:19.763238 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 02:26:19.763916 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 02:26:19.764040 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 02:26:19.764411 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 02:26:19.764497 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 02:26:19.764565 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 02:26:19.764631 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 02:26:19.764701 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 02:26:19.764887 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 02:26:19.764986 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.765183 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 02:26:19.765327 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.765563 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.765706 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.765853 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.765953 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.766211 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.766344 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.766500 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.766596 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.766847 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.766988 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.767158 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.767288 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.767478 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.767661 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.767750 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.767829 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.768054 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.768191 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.768425 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-13-iscsi {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.768574 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.768749 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.768888 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.769048 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.769190 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-13-iscsi {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.769342 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.769442 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.769658 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.769747 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.769960 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.770055 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.770279 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.770376 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.770583 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.770677 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.770907 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.771076 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.771486 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.771617 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.771731 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.771847 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.771983 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.772160 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.772345 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.772494 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.772672 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.772819 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.772979 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.773124 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.773282 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.773395 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.773590 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.773684 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.773913 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.774012 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.774228 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.774310 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.774558 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.774650 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-13-iscsi {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.774855 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.774946 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.775209 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.775290 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-13-iscsi {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.775523 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.775603 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.775848 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.775935 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.776185 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.776290 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.776548 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.776726 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.776867 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.776959 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.777186 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.777268 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.777506 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.777595 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.777830 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.777912 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.778136 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.778224 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.778465 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.778556 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.778786 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.778879 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.779080 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.779169 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.779387 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.779486 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.779692 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.779781 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780000 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780126 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780329 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780420 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780633 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780715 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780883 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.780970 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.781190 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.781280 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.781464 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.781545 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.781774 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.781863 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.782098 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.782189 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.782359 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.782442 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.782608 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.782717 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.782924 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.783016 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.783234 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.783319 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.783557 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.783649 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.783863 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.783958 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.784194 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.784300 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.784503 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.784593 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.784810 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.784891 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.785116 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.785196 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.785422 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.785511 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.785728 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.785808 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.786035 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.786123 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.786343 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.786424 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.786661 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.786741 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.786965 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.787055 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.787280 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.787363 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.787587 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.787667 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.787907 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.787995 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.788235 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.788319 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.788566 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.788646 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.788876 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.788970 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.789182 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.789263 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.789500 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.789581 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.789817 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.789906 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.790121 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.790208 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.790426 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.790521 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.790727 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.790817 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791030 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791110 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791339 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791428 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791651 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791740 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791899 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.791980 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.792221 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.792309 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.792524 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.792611 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.792824 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.792911 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.793129 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.793250 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.793432 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.793514 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.793736 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.793817 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.794034 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.794115 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.794683 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.794785 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.794981 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.795063 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.795286 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.795383 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.795589 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.795671 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.795891 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.795972 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.796223 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.796330 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.796531 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.796615 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.796836 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.796918 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.797138 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.797232 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.797453 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.797537 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.797760 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.797847 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.798064 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.798152 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.798372 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.798466 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.798675 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.798759 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.799030 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.799126 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.799336 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.799424 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.799640 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.799721 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.799945 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.800102 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.800286 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.800402 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.800590 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.800711 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.800893 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.801032 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.801208 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.801342 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.801511 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.801648 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.801832 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.801968 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.802127 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.802277 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.802424 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.802586 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.802725 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.802908 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.803046 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.803214 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.803352 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.803518 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.803633 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.803836 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.803917 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.804168 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.804254 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.804482 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.804578 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.804791 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.804893 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.805090 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.805173 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.805393 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.805485 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.805686 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.805767 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.805988 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.806075 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.806291 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.806388 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.806610 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.806694 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.806893 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.806981 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.807195 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.807277 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.807510 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.807592 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.807815 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.807906 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.808145 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.808241 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.808465 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:26:19.808553 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.808801 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.808882 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.809130 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.809214 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.809460 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.809542 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.809773 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.809853 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.810082 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.810170 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.810397 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.810479 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.810722 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.810811 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.811033 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.811153 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.811342 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.811429 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.811652 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.811748 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.811966 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.812054 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.812305 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.812387 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.812618 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.812716 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.812935 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.813015 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.813252 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.813348 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.813569 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.813662 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.813880 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.813969 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.814194 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.814282 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.814543 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.814635 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.814858 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.814959 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.815163 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.815244 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.815491 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.815582 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.815811 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.815893 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.816143 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.816230 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.816467 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.816550 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.816780 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.816861 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.817101 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.817184 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.817414 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.817497 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.817722 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.817810 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.818038 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.818128 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.818347 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.818429 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.818658 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.818740 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.818965 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.819047 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.819295 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.819378 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.819605 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.819685 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.819913 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.820006 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.820238 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.820322 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.820541 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.820624 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.820846 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.820942 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.821154 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.821236 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.821459 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.821546 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.821764 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.821856 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.822073 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.822156 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.822377 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.822458 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.822694 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.822783 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.822997 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.823079 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.823308 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.823389 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.823616 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.823699 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.823919 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.824000 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.824251 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.824336 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.824561 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.824654 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.824863 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.824961 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.825178 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.825270 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.825484 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.825568 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.825785 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.825915 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.826102 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.826184 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.826406 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.826489 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.826707 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.826788 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.827018 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.827109 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.827324 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.827413 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.827629 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.827710 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.827943 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.828034 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.828280 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.828372 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.828592 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.828718 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.828906 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.828998 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.829231 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.829314 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.829546 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.829628 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.829861 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.829958 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.830247 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.830338 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.830581 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.830664 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.830888 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.830972 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.831188 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.831271 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.831497 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.831579 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.831802 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.831890 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.832127 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.832231 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.832434 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.832524 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.832738 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.832829 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.833039 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.833121 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.833341 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.833424 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.833641 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.833723 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.833942 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.834023 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.834244 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.834339 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.834548 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.834631 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.834856 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.834944 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.835163 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.835283 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.835468 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.835555 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.835767 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.835866 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.836085 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.836191 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.836399 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.836483 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.836704 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.836793 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.837049 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.837140 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.837356 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.837446 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.837673 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.837754 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.837989 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.838072 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.838301 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.838393 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.838609 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.838693 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.838918 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.839004 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.839223 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.839305 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.839528 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.839610 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.839838 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.839922 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.840163 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.840279 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.840478 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.840561 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.840782 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.840864 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.841090 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.841178 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.841393 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.841485 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.841703 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.841787 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.842001 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.842081 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.842313 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.842405 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.842627 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.842708 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.842928 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.843010 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.843241 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.843332 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.843561 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.843643 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.843867 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.843949 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.844200 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.844311 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.844509 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.844591 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.844816 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.844898 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.845121 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.845211 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.845429 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.845522 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.845761 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.845851 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.846066 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.846194 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.846372 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.846454 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.846676 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.846764 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.846985 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.847067 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.847287 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.847368 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.847600 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.847680 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.847904 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.847988 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.848235 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.848320 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.848554 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.848634 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.848858 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.848942 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.849170 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.849259 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.849477 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.849566 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.849794 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.849875 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.850100 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.850181 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.850403 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.850493 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.850711 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.850793 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.851016 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.851098 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.851320 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.851414 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.851626 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.851707 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.851931 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.852011 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.852261 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.852356 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.852568 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.852658 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.852872 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.852954 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.853181 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.853272 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.853478 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.853562 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.853778 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.853861 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.854076 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.854161 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.854383 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.854465 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.854688 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.854776 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.854994 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.855083 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.855306 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.855395 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.855620 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.855709 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.855920 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.856003 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.856243 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.856328 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.856561 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.856642 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.856862 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.856950 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.857160 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.857282 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.857462 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.857552 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.857766 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.857848 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.858069 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.858149 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.858378 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.858469 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.858680 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.858762 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.858987 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.859066 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.859307 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.859399 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.859610 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.859691 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.859920 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.860000 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.860263 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.860359 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.860571 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.860660 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.860884 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.860971 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.861201 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.861296 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.861546 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.861628 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.861853 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.861935 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.862162 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.862247 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.862469 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.862550 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.862772 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.862853 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.863081 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.863163 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.863384 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.863463 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.863691 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.863774 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.863999 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.864154 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.864323 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.864405 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.864630 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.864729 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.864939 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.865028 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.865241 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.865507 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.865635 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.865837 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.865920 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.866151 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.866395 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.866477 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.866730 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.866821 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.867045 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.867127 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.867364 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.867446 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.867685 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.867776 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.867994 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.868349 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.868516 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.868632 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.868749 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.868835 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.868911 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.868992 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.869193 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.869286 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.869501 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.869591 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.869803 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.869886 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.870106 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.870188 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.870408 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.870498 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.870716 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.870796 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.871015 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.871095 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.871316 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.871397 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.871625 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.871706 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.871927 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.872016 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.872258 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.872355 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.872569 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.872657 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.872876 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.872958 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.873177 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.873268 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.873477 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.873559 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.873786 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.873869 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.874087 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.874169 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.874388 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.874472 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.874689 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.874771 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.874988 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.875076 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.875290 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.875373 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.875592 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.875713 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.875933 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.876024 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.876268 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.876352 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.876580 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.876663 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.876880 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.877006 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.877223 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.877330 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.877523 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.877605 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.877828 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.877912 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.878126 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.878208 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.878432 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.878513 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.878737 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.878819 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.879034 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.879113 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.879339 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.879420 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.879643 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.879724 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.879942 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.880028 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.880267 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.880350 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.880568 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.880652 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.880873 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.880953 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.881170 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.881258 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.881469 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.881557 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.881771 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.881851 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.882068 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.882157 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.882363 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.882443 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.882670 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.882758 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.882966 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.883055 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.883266 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.883348 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.883570 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.883650 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.883871 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.883964 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.884198 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.884284 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.884498 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.884579 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.884798 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.884888 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.885093 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.885175 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.885399 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.885480 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.885700 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.885772 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.885997 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.886154 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.886316 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.886468 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.886624 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.886777 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.886929 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.887079 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.887229 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.887403 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.887534 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.887715 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.887839 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.888021 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.888161 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.888360 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.888459 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.888669 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.888775 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.888969 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.889088 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.889272 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.889397 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.889581 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.889670 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.889903 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.889987 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.890220 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.890311 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.890523 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.890621 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.890826 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.890912 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.891124 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.891207 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.891426 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.891508 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.891724 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.891813 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.892021 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.892561 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.892671 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.892748 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.892837 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.892923 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893000 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893074 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893281 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893364 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893581 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893672 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893878 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.893960 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.894222 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.894312 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.894523 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.894615 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.894828 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.894909 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.895129 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.895218 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.895460 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.895550 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.895764 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.895845 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.896089 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.896174 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.896401 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.896485 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.896713 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.896796 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.897014 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.897094 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.897324 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.897406 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.897635 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.897725 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.897944 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.898026 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.898243 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.898334 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.898543 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.898624 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.898853 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.898934 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.899158 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.899247 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.899460 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.899549 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.899763 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.899854 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.900097 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.900183 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.900411 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.900493 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.900708 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.900800 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.901012 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.901094 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.901316 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.901420 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.901620 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.901749 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.901927 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.902057 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.902231 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.902365 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.902536 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.902675 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.902846 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.902985 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.903151 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.903296 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.903457 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.903605 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.903762 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.903918 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.904074 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.904257 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.904391 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.904569 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.904695 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.904879 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.904996 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.905187 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.905315 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.905494 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.905618 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.905804 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.905916 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.906114 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.906273 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.906417 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.906507 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.906742 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.906825 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.907050 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.907134 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.907353 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.907494 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.907664 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.907807 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.907968 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.908163 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.908422 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.908548 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.908651 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.908827 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.909139 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.909283 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.909456 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.909638 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.909740 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.909822 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.910061 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.910206 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.910372 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.910505 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.910681 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.910828 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911002 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911136 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911300 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911386 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911632 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911794 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911887 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.911976 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.912247 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.912397 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.912572 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.912719 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.912861 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.912955 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.913163 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.913253 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.913468 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.913567 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.913786 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.913877 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.914087 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.914177 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.914403 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.914494 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.914701 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.914796 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.915006 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.915096 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.915323 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.915413 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.915628 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.915789 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.915946 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.916098 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.916392 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.916491 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.916707 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.916796 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.917008 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.917109 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.917324 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.917409 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.917631 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.917716 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.917940 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.918034 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.918246 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.918331 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.918565 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.918658 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.918887 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.918984 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.919537 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.919629 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.919848 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.919932 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.920175 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.920280 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.920496 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.920583 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.920815 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.920899 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.921125 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.921217 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.921440 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.921525 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.921742 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.921827 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.922064 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.922152 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.922387 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.922473 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.922700 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.922785 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.923022 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.923117 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.923336 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.923422 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.923635 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.923747 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.923965 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.924126 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.924296 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.924457 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.924599 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.924785 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.924918 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.925094 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.925217 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.925398 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.925525 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.925710 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.925831 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.926016 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.926137 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.926321 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.926435 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.926644 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.926730 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.926949 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.927036 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.927261 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.927346 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.927572 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.927657 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.927880 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.927976 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.928207 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.928297 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.928513 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.928600 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.928835 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.928922 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.929137 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.929221 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.929449 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.929534 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.929754 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.929850 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.930055 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.930140 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.930355 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.930453 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.930666 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.930751 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.930982 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.931066 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.931287 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.931380 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.931591 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.931677 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.931896 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.931980 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.932223 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.932334 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.932562 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.932654 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.932863 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.932954 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.933181 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.933276 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.933489 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.933573 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.933808 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.933895 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.934110 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.934196 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.934410 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.934502 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.934714 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.934801 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.935018 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.935105 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.935319 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.935421 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.935616 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.935702 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.935921 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.936009 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.936242 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.936329 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.936542 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.936632 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.936840 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.936928 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.937144 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.937228 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.937441 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.937533 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.937747 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.937831 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.938049 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.938136 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.938347 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.938439 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.938647 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.938738 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.938943 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.939027 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.939279 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.939380 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.939627 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.939718 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.939956 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.940042 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.940296 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.940394 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.940599 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.940684 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.940900 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.940986 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.941216 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.941308 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.941535 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.941620 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.941845 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.941936 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.942156 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.942242 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.942468 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.942553 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.942779 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.942864 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.943084 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.943169 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.943395 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.943479 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.943705 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.943790 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.944009 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.944114 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.944345 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.944430 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.944657 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.944753 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.944973 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.945058 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.945285 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.945507 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.945592 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.945831 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.945921 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.946140 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.946225 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.946451 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.946583 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.946760 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.946847 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.947068 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.947316 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.947401 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.947645 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.947740 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.947958 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.948043 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.948288 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.948375 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.948596 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.948685 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.948908 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.948998 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.949223 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.949307 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.949536 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.949624 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.949846 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.949932 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.950156 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.950240 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.950462 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.950554 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.950775 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.950861 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.951084 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.951178 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.951404 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.951488 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.951732 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.951816 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.952036 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.952202 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.952365 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.952451 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.952676 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.952762 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.952983 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.953070 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.953292 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.953385 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.953600 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.953685 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.953907 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.953993 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.954216 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.954301 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.954524 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.954618 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.954829 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.954923 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.955159 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.955246 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.955467 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.955559 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.955781 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.955871 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.956110 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.956211 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.956422 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.956518 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.956731 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.956816 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.957041 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.957126 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.957352 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.957446 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.957674 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.957896 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.958009 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.958206 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.958327 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.958532 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.958625 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.958855 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.958948 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.959174 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.959268 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.959490 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.959730 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.959816 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.960045 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.960207 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.960399 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.960487 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.960709 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.960792 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.961017 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.961111 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.961339 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.961435 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.961622 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.961707 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.961941 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.962035 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.962244 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.962328 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.962542 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.962632 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.962849 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.962947 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.963154 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.963238 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.963456 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.963680 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.963766 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.964030 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.964154 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.964369 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.964459 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.964694 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.964794 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.964999 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.965083 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.965318 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.965529 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.965622 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.965878 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.965965 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.966195 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.966281 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.966513 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.966596 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.966826 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.966912 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.967134 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.967218 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.967436 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.967521 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.967741 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.967828 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.968050 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.968171 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.968375 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.968469 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.968678 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.968776 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.968984 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.969071 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.969285 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.969377 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.969591 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.969677 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.969896 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.969988 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.970199 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.970294 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.970499 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.970583 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.970853 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.970942 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.971156 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.971250 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.971455 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.971549 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.971758 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.971843 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.972056 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.972195 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.972385 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.972469 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.972684 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.972767 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.972986 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.973073 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.973284 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.973374 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.973586 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.973678 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.973948 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.974035 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.974179 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.974266 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.974479 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.974566 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.974788 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.974874 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.975089 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.975172 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.975388 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.975482 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.975688 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.975772 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.975995 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.976108 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.976326 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.976424 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.976634 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.976718 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.976937 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.977021 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.977239 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.977337 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.977556 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.977641 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.977865 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.978099 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.978196 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.978475 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.978592 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.978783 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.978867 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.979122 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.979214 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.979435 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.979520 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.979748 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.979962 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.980048 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.980366 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.980452 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.980685 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.980791 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.980992 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.981077 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.981302 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.981390 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.981608 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.981693 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.981918 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.982002 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.982218 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.982303 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.982520 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.982606 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.982827 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.982925 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.983133 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.983220 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.983439 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.983524 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.983748 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.983841 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.984084 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.984174 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.984394 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.984480 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.984701 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.984797 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.985010 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.985104 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.985320 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.985406 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.985627 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.985713 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.985933 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.986024 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.986239 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.986345 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.986566 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.986652 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.986876 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.986961 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.987201 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.987291 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.987511 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.987640 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.987809 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.987901 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.988136 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.988303 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.988449 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.988543 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.988762 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.988847 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.989093 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.989188 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.989407 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.989501 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.989711 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.989796 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.990055 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.990147 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.990362 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.990493 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.990680 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.990766 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.990984 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.991070 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.991307 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.991393 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.991641 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.991740 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.991959 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.992045 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.992296 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.992384 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.992597 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.992688 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.992897 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.992991 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.993197 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.993290 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.993501 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.993594 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.993829 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.993914 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.994157 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.994243 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.994467 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.994560 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.994771 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.994864 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.995076 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.995179 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.995385 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.995482 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.995687 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.995771 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.996004 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.996120 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.996345 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.996440 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.996656 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.996745 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.996961 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.997058 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.997281 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.997370 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.997589 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.997675 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.997897 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.997988 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.998206 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.998293 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.998513 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.998610 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.998818 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.998913 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.999124 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.999218 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.999440 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.999524 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.999752 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:19.999838 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.000055 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.000195 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.000391 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.000476 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.000702 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.000799 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.001015 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.001102 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.001322 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.001406 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.001631 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.001725 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.002000 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.002098 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.002312 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.002397 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.002627 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.002721 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.002936 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.003031 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.003246 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.003339 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.003560 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.003646 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.003874 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.003966 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.004231 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.004324 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.004557 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.004644 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.004880 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.004965 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.005193 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.005279 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.005513 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.005600 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.005832 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.005917 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.006160 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.006254 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.006481 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.006573 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.006791 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.006876 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.007099 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.007193 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.007405 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.007497 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.007643 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 02:26:20.007757 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.008124 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.008458 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.008773 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.009087 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.009395 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:26:20.009638 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 02:26:20.029971 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_db.sqlalchemy.engines [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.031475 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_db.sqlalchemy.engines [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.097023 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.context [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7(cell1) {{(pid=101931) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 02:26:20.099413 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.context [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7(cell1) {{(pid=101932) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 02:26:20.101260 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:26:20.102996 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:26:20.103690 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_concurrency.lockutils [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:26:20.103823 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:26:20.105342 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_concurrency.lockutils [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:26:20.105763 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:26:20.106152 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_concurrency.lockutils [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:26:20.108140 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_concurrency.lockutils [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:26:20.116664 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_db.sqlalchemy.engines [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.119065 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_db.sqlalchemy.engines [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.124034 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_db.sqlalchemy.engines [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.126305 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_db.sqlalchemy.engines [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.286992 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_db.sqlalchemy.engines [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.292724 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG oslo_db.sqlalchemy.engines [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:26:20.631640 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: WARNING keystonemiddleware.auth_token [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:26:20.632611 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: WARNING keystonemiddleware.auth_token [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:26:20.638289 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: WARNING keystonemiddleware.auth_token [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:26:20.639282 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: WARNING keystonemiddleware.auth_token [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:26:20.981762 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: WARNING keystonemiddleware.auth_token [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:26:20.983376 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: WARNING keystonemiddleware.auth_token [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:26:20.987123 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: WARNING keystonemiddleware.auth_token [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:26:20.990461 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: WARNING keystonemiddleware.auth_token [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:26:20.992310 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3665589c0 pid: 101931 (default app) Jan 17 02:26:20.994386 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:26:20.995572 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-8d13a64e-1acb-4149-b66e-510f7e120d08 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Jan 17 02:26:20.995728 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3665589c0 pid: 101932 (default app) Jan 17 02:26:20.995981 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Mon Jan 17 02:26:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:27:45.726220 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:27:45.727386 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Jan 17 02:27:45.727792 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:27:46.152645 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-e21bc1b1-b931-4dea-b7e0-6c3e3b09be88 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:27:46.182649 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-e21bc1b1-b931-4dea-b7e0-6c3e3b09be88 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448531 Jan 17 02:27:46.192133 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 2/3] 10.222.0.24 () {60 vars in 1291 bytes} [Mon Jan 17 02:27:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:27:48.402722 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:27:48.403743 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-df90fda3-b62f-42a0-8e84-70e956d1daca None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jan 17 02:27:48.404463 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 2/4] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:27:48.468561 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-35d504d8-d6fd-4126-82ee-7db385e3c14d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:48.491146 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:27:48.491146 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: warnings.warn(msg) Jan 17 02:27:48.520351 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-35d504d8-d6fd-4126-82ee-7db385e3c14d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108410 Jan 17 02:27:48.520909 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 3/5] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:27:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:27:48.735093 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-832989ff-7a5e-484b-88ec-3eae49e910f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:48.737545 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:27:48.737545 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: warnings.warn(msg) Jan 17 02:27:48.790584 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-832989ff-7a5e-484b-88ec-3eae49e910f1 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261503 Jan 17 02:27:48.791594 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 3/6] 10.222.0.24 () {64 vars in 1335 bytes} [Mon Jan 17 02:27:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:27:51.032058 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-35d504d8-d6fd-4126-82ee-7db385e3c14d admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:27:51.033114 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-35d504d8-d6fd-4126-82ee-7db385e3c14d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jan 17 02:27:51.033510 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 4/7] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:27:51.140493 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-ad5bbf57-252a-4cee-8df4-b802c8b9dd1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "name": "ds512M", "vcpus": 1, "disk": 5}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:51.158080 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:27:51.158080 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: warnings.warn(msg) Jan 17 02:27:51.180510 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-ad5bbf57-252a-4cee-8df4-b802c8b9dd1f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141116 Jan 17 02:27:51.181224 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 4/8] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:27:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:27:51.193090 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-e76430cb-5941-472b-be67-2f4c481d72e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:51.194655 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:27:51.194655 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: warnings.warn(msg) Jan 17 02:27:51.228894 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-e76430cb-5941-472b-be67-2f4c481d72e2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039411 Jan 17 02:27:51.229409 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 5/9] 10.222.0.24 () {64 vars in 1335 bytes} [Mon Jan 17 02:27:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:27:53.476671 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-ad5bbf57-252a-4cee-8df4-b802c8b9dd1f admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:27:53.477683 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-ad5bbf57-252a-4cee-8df4-b802c8b9dd1f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jan 17 02:27:53.478061 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:27:53.535921 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-acb48dac-77e0-42a6-ad63-bd5174538ede admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:53.557670 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-acb48dac-77e0-42a6-ad63-bd5174538ede admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073272 Jan 17 02:27:53.558415 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 6/11] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:27:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:27:53.570131 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8621ef15-4e88-4410-b486-c0186a12f59a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:53.593830 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8621ef15-4e88-4410-b486-c0186a12f59a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027283 Jan 17 02:27:53.594416 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 6/12] 10.222.0.24 () {64 vars in 1335 bytes} [Mon Jan 17 02:27:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:27:55.859450 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-acb48dac-77e0-42a6-ad63-bd5174538ede admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:27:55.860518 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-acb48dac-77e0-42a6-ad63-bd5174538ede admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jan 17 02:27:55.860944 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 7/13] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:27:55.927840 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-f19bd4c5-765d-48d9-bd02-ab824c3ed01b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "ram": 2048, "name": "ds2G", "disk": 10}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:55.947188 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-f19bd4c5-765d-48d9-bd02-ab824c3ed01b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079979 Jan 17 02:27:55.947802 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 7/14] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:27:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:27:55.959571 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-512eb649-58fb-4857-9767-52c535f19809 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:55.987517 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-512eb649-58fb-4857-9767-52c535f19809 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031564 Jan 17 02:27:55.988494 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 8/15] 10.222.0.24 () {64 vars in 1335 bytes} [Mon Jan 17 02:27:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:27:58.225798 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-f19bd4c5-765d-48d9-bd02-ab824c3ed01b admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:27:58.226803 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-f19bd4c5-765d-48d9-bd02-ab824c3ed01b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jan 17 02:27:58.227429 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 8/16] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:27:58.290363 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-6d17cfc8-b1b4-4b31-91a2-9231ade8004a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:58.312815 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-6d17cfc8-b1b4-4b31-91a2-9231ade8004a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079359 Jan 17 02:27:58.313508 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 9/17] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:27:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:27:58.325642 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-6d613c04-a5a3-431d-9b75-94386b79f80a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:27:58.348776 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-6d613c04-a5a3-431d-9b75-94386b79f80a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027171 Jan 17 02:27:58.349741 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 9/18] 10.222.0.24 () {64 vars in 1335 bytes} [Mon Jan 17 02:27:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:28:00.567277 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-6d17cfc8-b1b4-4b31-91a2-9231ade8004a admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:00.568359 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-6d17cfc8-b1b4-4b31-91a2-9231ade8004a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 17 02:28:00.568734 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 10/19] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:00.629631 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-1d303cb5-d344-4023-ba7e-e82985697915 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:00.652775 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-1d303cb5-d344-4023-ba7e-e82985697915 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077783 Jan 17 02:28:00.660131 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 10/20] 10.222.0.24 () {60 vars in 1291 bytes} [Mon Jan 17 02:28:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:03.140804 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-6d17cfc8-b1b4-4b31-91a2-9231ade8004a admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:03.141816 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-6d17cfc8-b1b4-4b31-91a2-9231ade8004a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jan 17 02:28:03.142220 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 11/21] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:03.207323 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8681167a-e373-4326-ad76-ba19a117b45f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "id": "1", "disk": 1}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:03.227387 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8681167a-e373-4326-ad76-ba19a117b45f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078428 Jan 17 02:28:03.227973 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 11/22] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:28:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:28:03.240678 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-6ff8ca6a-2307-4b2d-bb1b-69e26ed96325 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:03.264372 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-6ff8ca6a-2307-4b2d-bb1b-69e26ed96325 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027482 Jan 17 02:28:03.264980 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 12/23] 10.222.0.24 () {64 vars in 1332 bytes} [Mon Jan 17 02:28:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:28:05.595376 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8681167a-e373-4326-ad76-ba19a117b45f admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:05.596572 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8681167a-e373-4326-ad76-ba19a117b45f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Jan 17 02:28:05.597037 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 12/24] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:05.654682 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-b6f407a9-f7f2-488a-b47a-1e599f1b61df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 2048, "disk": 20}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:05.675580 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-b6f407a9-f7f2-488a-b47a-1e599f1b61df admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072055 Jan 17 02:28:05.681148 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 13/25] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:28:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:28:05.688850 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-bbc78232-44d9-4ee9-bb8b-38d42274f69e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:05.712517 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-bbc78232-44d9-4ee9-bb8b-38d42274f69e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027349 Jan 17 02:28:05.713091 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 13/26] 10.222.0.24 () {64 vars in 1332 bytes} [Mon Jan 17 02:28:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:28:07.970567 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-b6f407a9-f7f2-488a-b47a-1e599f1b61df admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:07.971703 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-b6f407a9-f7f2-488a-b47a-1e599f1b61df admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jan 17 02:28:07.972117 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 14/27] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:28:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:08.035836 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-9cd7fe0b-b028-435f-b46d-e8d583f30215 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "id": "3"}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:08.057772 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-9cd7fe0b-b028-435f-b46d-e8d583f30215 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078871 Jan 17 02:28:08.058311 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 14/28] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:28:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:28:08.070292 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-304d3a28-d850-4c14-bdbf-bd4b0abe3dd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:08.095622 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-304d3a28-d850-4c14-bdbf-bd4b0abe3dd8 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029053 Jan 17 02:28:08.096590 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 15/29] 10.222.0.24 () {64 vars in 1332 bytes} [Mon Jan 17 02:28:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:28:10.312177 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-9cd7fe0b-b028-435f-b46d-e8d583f30215 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:10.313670 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-9cd7fe0b-b028-435f-b46d-e8d583f30215 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 Jan 17 02:28:10.316356 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 15/30] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:28:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:10.378430 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-e34c884e-6943-48d2-814b-ceb329e4e859 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "swap": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:10.401091 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-e34c884e-6943-48d2-814b-ceb329e4e859 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080651 Jan 17 02:28:10.401926 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 16/31] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:28:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:28:10.417697 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-34889909-8f19-4a6f-9403-a88b4a4d26e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:10.458745 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-34889909-8f19-4a6f-9403-a88b4a4d26e0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044907 Jan 17 02:28:10.459326 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 16/32] 10.222.0.24 () {64 vars in 1332 bytes} [Mon Jan 17 02:28:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:28:12.682391 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-e34c884e-6943-48d2-814b-ceb329e4e859 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:12.683501 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-e34c884e-6943-48d2-814b-ceb329e4e859 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jan 17 02:28:12.683898 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 17/33] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:12.748407 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-241d2ccd-01f8-4482-b16b-0b67a508b3f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "vcpus": 8, "swap": 0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:12.768347 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-241d2ccd-01f8-4482-b16b-0b67a508b3f0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078277 Jan 17 02:28:12.772461 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 17/34] 10.222.0.24 () {64 vars in 1282 bytes} [Mon Jan 17 02:28:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:28:12.781260 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-89b409d5-4a21-4081-b8bb-a28d89e8f68c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:12.807372 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-89b409d5-4a21-4081-b8bb-a28d89e8f68c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030139 Jan 17 02:28:12.808552 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 18/35] 10.222.0.24 () {64 vars in 1332 bytes} [Mon Jan 17 02:28:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:28:35.354703 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-241d2ccd-01f8-4482-b16b-0b67a508b3f0 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:35.355715 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-241d2ccd-01f8-4482-b16b-0b67a508b3f0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jan 17 02:28:35.356102 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 18/36] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:35.419759 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-157a87ad-0343-4368-87d1-ba3a2fb069fd admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:35.440101 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-157a87ad-0343-4368-87d1-ba3a2fb069fd admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077053 Jan 17 02:28:35.440767 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 19/37] 10.222.0.24 () {60 vars in 1291 bytes} [Mon Jan 17 02:28:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:36.800467 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-241d2ccd-01f8-4482-b16b-0b67a508b3f0 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:36.801464 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-241d2ccd-01f8-4482-b16b-0b67a508b3f0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jan 17 02:28:36.802008 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 19/38] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:37.037793 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-12cfa7e0-3003-4216-a358-97867c7c4cfb admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:37.046803 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.wsgi [None req-12cfa7e0-3003-4216-a358-97867c7c4cfb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 17 02:28:37.047659 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-12cfa7e0-3003-4216-a358-97867c7c4cfb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:28:37.049037 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-12cfa7e0-3003-4216-a358-97867c7c4cfb admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.076700 Jan 17 02:28:37.049524 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 20/39] 10.222.0.24 () {60 vars in 1190 bytes} [Mon Jan 17 02:28:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 02:28:37.059037 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-2f1a6ff4-17d2-4e31-a017-08d948f91830 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:37.079735 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-2f1a6ff4-17d2-4e31-a017-08d948f91830 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024186 Jan 17 02:28:37.080272 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 20/40] 10.222.0.24 () {60 vars in 1210 bytes} [Mon Jan 17 02:28:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:37.089767 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-883240d3-1ae7-46df-aa64-6d54289e2db3 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:37.110739 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-883240d3-1ae7-46df-aa64-6d54289e2db3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024415 Jan 17 02:28:37.111285 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 21/41] 10.222.0.24 () {60 vars in 1210 bytes} [Mon Jan 17 02:28:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:37.120490 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-83655092-479b-4fb7-bcb4-c76ea8cf8d99 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:37.126249 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.wsgi [None req-83655092-479b-4fb7-bcb4-c76ea8cf8d99 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 17 02:28:37.126816 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-83655092-479b-4fb7-bcb4-c76ea8cf8d99 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:28:37.127637 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-83655092-479b-4fb7-bcb4-c76ea8cf8d99 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010635 Jan 17 02:28:37.128128 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 21/42] 10.222.0.24 () {60 vars in 1190 bytes} [Mon Jan 17 02:28:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 02:28:38.384005 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-883240d3-1ae7-46df-aa64-6d54289e2db3 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:38.385089 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-883240d3-1ae7-46df-aa64-6d54289e2db3 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jan 17 02:28:38.385475 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 22/43] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:38.588327 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-c2787909-68d0-4a64-8e7b-49259cc927fb admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:38.595895 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.wsgi [None req-c2787909-68d0-4a64-8e7b-49259cc927fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 17 02:28:38.596554 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-c2787909-68d0-4a64-8e7b-49259cc927fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:28:38.597340 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-c2787909-68d0-4a64-8e7b-49259cc927fb admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072170 Jan 17 02:28:38.597854 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 22/44] 10.222.0.24 () {60 vars in 1190 bytes} [Mon Jan 17 02:28:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 02:28:38.607446 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-aa0ee25c-3aa3-4973-93fa-e27b66f3c9a8 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:38.620679 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-aa0ee25c-3aa3-4973-93fa-e27b66f3c9a8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016791 Jan 17 02:28:38.621234 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 23/45] 10.222.0.24 () {60 vars in 1210 bytes} [Mon Jan 17 02:28:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:38.630349 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-212b45c4-1bc7-450d-9673-25fb227a6a28 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:38.643971 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-212b45c4-1bc7-450d-9673-25fb227a6a28 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017060 Jan 17 02:28:38.644580 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 23/46] 10.222.0.24 () {60 vars in 1210 bytes} [Mon Jan 17 02:28:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:38.653506 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-89b578db-03ef-489a-a5a7-eaf6af28f0e9 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:38.658986 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.wsgi [None req-89b578db-03ef-489a-a5a7-eaf6af28f0e9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 17 02:28:38.659533 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-89b578db-03ef-489a-a5a7-eaf6af28f0e9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:28:38.660331 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-89b578db-03ef-489a-a5a7-eaf6af28f0e9 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010236 Jan 17 02:28:38.660812 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 24/47] 10.222.0.24 () {60 vars in 1190 bytes} [Mon Jan 17 02:28:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 02:28:39.917908 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-212b45c4-1bc7-450d-9673-25fb227a6a28 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:39.918907 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-212b45c4-1bc7-450d-9673-25fb227a6a28 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 17 02:28:39.919315 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 24/48] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:40.122978 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-fbbe50e3-4e5c-4900-90b1-e68f538280fa admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:40.128607 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.wsgi [None req-fbbe50e3-4e5c-4900-90b1-e68f538280fa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 17 02:28:40.129173 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-fbbe50e3-4e5c-4900-90b1-e68f538280fa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:28:40.129991 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-fbbe50e3-4e5c-4900-90b1-e68f538280fa admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070030 Jan 17 02:28:40.130496 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 25/49] 10.222.0.24 () {60 vars in 1193 bytes} [Mon Jan 17 02:28:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 02:28:40.145260 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-1a4d1f9b-c14e-4746-9b2c-e6fcbbe4ab4a admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:40.163951 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-1a4d1f9b-c14e-4746-9b2c-e6fcbbe4ab4a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024615 Jan 17 02:28:40.164510 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 25/50] 10.222.0.24 () {60 vars in 1210 bytes} [Mon Jan 17 02:28:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:40.174895 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:40.188573 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017635 Jan 17 02:28:40.189101 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 26/51] 10.222.0.24 () {60 vars in 1210 bytes} [Mon Jan 17 02:28:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:28:40.198376 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-77375b28-3cf5-4b3d-a453-b0e75c3474b3 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:40.203924 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.wsgi [None req-77375b28-3cf5-4b3d-a453-b0e75c3474b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 17 02:28:40.204507 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-77375b28-3cf5-4b3d-a453-b0e75c3474b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:28:40.205285 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-77375b28-3cf5-4b3d-a453-b0e75c3474b3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010506 Jan 17 02:28:40.205788 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 26/52] 10.222.0.24 () {60 vars in 1193 bytes} [Mon Jan 17 02:28:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 02:28:41.456366 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:41.457401 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jan 17 02:28:41.457940 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 27/53] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:41.656714 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-560f50ea-ff1f-4550-aa0f-a768582ea091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:41.678876 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-560f50ea-ff1f-4550-aa0f-a768582ea091 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081701 Jan 17 02:28:41.679425 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 27/54] 10.222.0.24 () {64 vars in 1235 bytes} [Mon Jan 17 02:28:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:28:42.919551 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:42.920594 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 17 02:28:42.920986 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 28/55] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:43.116789 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-09215dd2-42cb-458d-9cc4-81911b4b2749 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:43.140764 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-09215dd2-42cb-458d-9cc4-81911b4b2749 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.079792 Jan 17 02:28:43.141311 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 28/56] 10.222.0.24 () {64 vars in 1235 bytes} [Mon Jan 17 02:28:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:28:44.384766 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:44.385763 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 17 02:28:44.386155 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 29/57] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:44.579463 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-a7d32553-88a4-4054-a7f0-19c2436e7c20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:44.599975 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-a7d32553-88a4-4054-a7f0-19c2436e7c20 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071817 Jan 17 02:28:44.600516 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 29/58] 10.222.0.24 () {64 vars in 1235 bytes} [Mon Jan 17 02:28:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:28:45.839495 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:45.840542 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Jan 17 02:28:45.840934 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 30/59] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:46.042116 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-4ff50f7f-7891-486f-a4be-db4e8ea06514 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:28:46.063409 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-4ff50f7f-7891-486f-a4be-db4e8ea06514 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082402 Jan 17 02:28:46.063863 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 30/60] 10.222.0.24 () {64 vars in 1235 bytes} [Mon Jan 17 02:28:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:28:47.309435 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:47.310506 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jan 17 02:28:47.310894 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 31/61] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:28:47.505810 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-c47ba33d-150c-4c0a-9a12-a4c0ede2e507 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:28:47.525035 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-c47ba33d-150c-4c0a-9a12-a4c0ede2e507 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073061 Jan 17 02:28:47.525585 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 31/62] 10.222.0.24 () {60 vars in 1202 bytes} [Mon Jan 17 02:28:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:29:33.088714 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:29:33.090033 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-0a81484d-920f-4e20-8e7f-07ca937133cc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Jan 17 02:29:33.090491 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 32/63] 10.222.0.24 () {54 vars in 930 bytes} [Mon Jan 17 02:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:29:33.158434 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-67926c68-f01c-46c0-8892-7ac9073147d6 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:29:33.178207 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-67926c68-f01c-46c0-8892-7ac9073147d6 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079039 Jan 17 02:29:33.178733 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 32/64] 10.222.0.24 () {60 vars in 1291 bytes} [Mon Jan 17 02:29:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:29:33.201286 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-d583021b-a89b-4f41-baf2-5a675a0e65dd admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:29:33.209024 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-d583021b-a89b-4f41-baf2-5a675a0e65dd admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011351 Jan 17 02:29:33.209535 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 33/65] 10.222.0.24 () {60 vars in 1282 bytes} [Mon Jan 17 02:29:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:29:33.220507 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-45f5b394-f711-46b0-bebc-29774b4487bd admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:29:33.228296 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-45f5b394-f711-46b0-bebc-29774b4487bd admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011095 Jan 17 02:29:33.228806 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 33/66] 10.222.0.24 () {60 vars in 1285 bytes} [Mon Jan 17 02:29:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:29:33.239766 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-c1917157-87f0-408d-942d-344741e7f006 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:29:33.247762 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-c1917157-87f0-408d-942d-344741e7f006 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011442 Jan 17 02:29:33.248327 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 34/67] 10.222.0.24 () {60 vars in 1285 bytes} [Mon Jan 17 02:29:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:29:33.259983 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:29:33.268086 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011358 Jan 17 02:29:33.268574 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 34/68] 10.222.0.24 () {60 vars in 1282 bytes} [Mon Jan 17 02:29:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:30:59.112298 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-e3228b4e-ea2a-4c86-a91c-ef233bf54464 tempest-verify_tempest_config-957425569 tempest-verify_tempest_config-957425569-project] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:30:59.114246 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-e3228b4e-ea2a-4c86-a91c-ef233bf54464 tempest-verify_tempest_config-957425569 tempest-verify_tempest_config-957425569-project] 10.222.0.24 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108731 Jan 17 02:30:59.114774 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 35/69] 10.222.0.24 () {58 vars in 1133 bytes} [Mon Jan 17 02:30:59 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:32:30.310628 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:30.311626 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jan 17 02:32:30.312017 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 35/70] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:32:30.570909 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-cac26566-d231-468c-bf2f-c5b520f0beeb admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:30.572086 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:32:30.572086 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: warnings.warn(msg) Jan 17 02:32:30.573614 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-cac26566-d231-468c-bf2f-c5b520f0beeb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:30.574050 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-cac26566-d231-468c-bf2f-c5b520f0beeb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:30.574829 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-cac26566-d231-468c-bf2f-c5b520f0beeb admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:30.575243 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-cac26566-d231-468c-bf2f-c5b520f0beeb admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:30.607375 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-cac26566-d231-468c-bf2f-c5b520f0beeb admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154061 Jan 17 02:32:30.607939 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 36/71] 10.222.0.24 () {60 vars in 1193 bytes} [Mon Jan 17 02:32:30 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:32:31.872549 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:31.873580 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jan 17 02:32:31.873946 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 36/72] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:32:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:32:32.086785 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-707eec39-0871-4bad-b024-95c74fc66366 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:32.087982 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:32:32.087982 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: warnings.warn(msg) Jan 17 02:32:32.089539 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-707eec39-0871-4bad-b024-95c74fc66366 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:32.089980 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-707eec39-0871-4bad-b024-95c74fc66366 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:32.090770 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-707eec39-0871-4bad-b024-95c74fc66366 admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:32.091197 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-707eec39-0871-4bad-b024-95c74fc66366 admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:32.110529 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-707eec39-0871-4bad-b024-95c74fc66366 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.091156 Jan 17 02:32:32.111091 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 37/73] 10.222.0.24 () {60 vars in 1193 bytes} [Mon Jan 17 02:32:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:32:43.837536 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:43.838531 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 17 02:32:43.838943 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 37/74] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:32:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:32:44.035371 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-a3a3dc6a-ac85-47b2-be8d-3344fac61824 admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:44.036600 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:32:44.036600 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: warnings.warn(msg) Jan 17 02:32:44.038476 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-a3a3dc6a-ac85-47b2-be8d-3344fac61824 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:44.038909 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-a3a3dc6a-ac85-47b2-be8d-3344fac61824 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:44.039699 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-a3a3dc6a-ac85-47b2-be8d-3344fac61824 admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:44.040124 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-a3a3dc6a-ac85-47b2-be8d-3344fac61824 admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:44.063709 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-a3a3dc6a-ac85-47b2-be8d-3344fac61824 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083527 Jan 17 02:32:44.064202 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 38/75] 10.222.0.24 () {60 vars in 1193 bytes} [Mon Jan 17 02:32:43 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:32:45.335839 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: DEBUG nova.api.openstack.wsgi [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] Calling method '>' {{(pid=101932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:45.336889 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: INFO nova.api.openstack.requestlog [None req-8ecbd6a4-9abd-46b8-8370-7107457bd678 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jan 17 02:32:45.337278 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: [pid: 101932|app: 0|req: 38/76] 10.222.0.24 () {56 vars in 1074 bytes} [Mon Jan 17 02:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:32:45.542535 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG nova.api.openstack.wsgi [None req-fe986224-5c95-4b27-9f18-70621be4863e admin admin] Calling method '>' {{(pid=101931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:32:45.543727 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:32:45.543727 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: warnings.warn(msg) Jan 17 02:32:45.545273 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-fe986224-5c95-4b27-9f18-70621be4863e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:45.545742 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-fe986224-5c95-4b27-9f18-70621be4863e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:45.546502 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-fe986224-5c95-4b27-9f18-70621be4863e admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:32:45.546924 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: DEBUG oslo_concurrency.lockutils [None req-fe986224-5c95-4b27-9f18-70621be4863e admin admin] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:32:45.567650 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: INFO nova.api.openstack.requestlog [None req-fe986224-5c95-4b27-9f18-70621be4863e admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.089383 Jan 17 02:32:45.568206 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: [pid: 101931|app: 0|req: 39/77] 10.222.0.24 () {60 vars in 1193 bytes} [Mon Jan 17 02:32:45 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:33:44.126644 dv-cinder-821602-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 17 02:33:44.127156 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: Mon Jan 17 02:33:44 2022 - graceful shutdown triggered... Jan 17 02:33:44.127616 dv-cinder-821602-13-iscsi devstack@n-api.service[101931]: Gracefully killing worker 1 (pid: 101931)... Jan 17 02:33:44.128051 dv-cinder-821602-13-iscsi devstack@n-api.service[101932]: Gracefully killing worker 2 (pid: 101932)... Jan 17 02:33:45.128244 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: worker 1 buried after 1 seconds Jan 17 02:33:45.128244 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: worker 2 buried after 1 seconds Jan 17 02:33:45.128244 dv-cinder-821602-13-iscsi devstack@n-api.service[101930]: goodbye to uWSGI. Jan 17 02:33:45.130771 dv-cinder-821602-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 17 02:33:45.131653 dv-cinder-821602-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 17 02:33:45.135970 dv-cinder-821602-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 17 02:33:45.149802 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 17 02:33:45 2022] *** Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: nodename: dv-cinder-821602-13-iscsi Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: machine: x86_64 Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: clock source: unix Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: pcre jit disabled Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: detected number of CPU cores: 4 Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: current working directory: / Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: detected binary path: /usr/bin/uwsgi-core Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: your processes number limit is 47680 Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: your memory page size is 4096 bytes Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: detected max file descriptor number: 2048 Jan 17 02:33:45.152481 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: lock engine: pthread robust mutexes Jan 17 02:33:45.154038 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: thunder lock: enabled Jan 17 02:33:45.154038 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 17 02:33:45.154038 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 17 02:33:45.197927 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: Python main interpreter initialized at 0x558b79d369c0 Jan 17 02:33:45.197927 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: python threads support enabled Jan 17 02:33:45.197927 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: your server socket listen backlog is limited to 100 connections Jan 17 02:33:45.197927 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: your mercy for graceful operations on workers is 90 seconds Jan 17 02:33:45.198372 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: mapped 403077 bytes (393 KB) for 2 cores Jan 17 02:33:45.198372 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: *** Operational MODE: preforking *** Jan 17 02:33:45.198631 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: *** uWSGI is running in multiple interpreter mode *** Jan 17 02:33:45.198631 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: spawned uWSGI master process (pid: 122770) Jan 17 02:33:45.198849 dv-cinder-821602-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 17 02:33:45.199562 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: spawned uWSGI worker 1 (pid: 122781, cores: 1) Jan 17 02:33:45.199833 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: spawned uWSGI worker 2 (pid: 122782, cores: 1) Jan 17 02:33:45.200252 dv-cinder-821602-13-iscsi devstack@n-api.service[122770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 17 02:33:47.172238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:33:47.172238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: from cryptography.utils import int_from_bytes Jan 17 02:33:47.172971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:33:47.172971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: from cryptography.utils import int_from_bytes Jan 17 02:33:47.201329 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:33:47.201329 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: from cryptography.utils import int_from_bytes Jan 17 02:33:47.202025 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 02:33:47.202025 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: from cryptography.utils import int_from_bytes Jan 17 02:33:49.536444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 02:33:49.537309 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 02:33:49.537546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 02:33:49.537904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 02:33:49.538351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 02:33:49.538992 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.539478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.540046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.540561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.541102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.541427 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.541755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.542085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.542423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.542690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.543013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.543376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-13-iscsi {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.543759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.544268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.544753 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.545286 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.545598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.546198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.546755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.547580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.548118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.548541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.549085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.549637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.550166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.550692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.551226 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.551755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.552332 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.552717 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.553755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-13-iscsi {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.553755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.553957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.554300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.554810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.555137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.555566 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.555906 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.556269 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.556590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.556930 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.557262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.557592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.557925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.558238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.558557 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.558902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.559272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.559588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.559900 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.560238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.560556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.560887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.561218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.561552 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.561811 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.562070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.562398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.562730 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.563050 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.563368 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.563681 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.563993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.564328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.564645 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.564959 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.565270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.565598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.565921 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.566246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.566632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.566876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.567279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.567535 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.567848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.568260 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.568707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.569612 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.569612 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.570483 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.571028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.571545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.572093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.572660 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.573219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.573751 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.574223 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.574779 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.575303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.575841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.576396 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.576929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.577440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.578028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.578556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.579092 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.579628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.580181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.580710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.581232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.581743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.582273 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.582784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.583313 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.583840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.584376 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 02:33:49.584831 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.584922 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 02:33:49.584995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.584995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.585126 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 02:33:49.585437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.585553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 02:33:49.585761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 02:33:49.585858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.586126 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.586228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.586457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.586593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.586783 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.587073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.587180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.587428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.587531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.587744 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.587834 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.588144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.588481 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.588649 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.588818 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.589032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.589188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.589340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.589496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.589661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.589827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.590040 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-13-iscsi {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.590234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.590398 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.590555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.590697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.590841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.590986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.591130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.591278 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.591428 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.591569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.591727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.591874 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.592013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.592209 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.592357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.592357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.592634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.592931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.593185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.593348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.593497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.593653 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.593802 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.593947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.594097 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.594245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.594390 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.594536 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.594673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.594818 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.594969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.595107 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.595252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.595389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.595537 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.595692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.595850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.596057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.596306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-13-iscsi {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.596449 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.596688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.596844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.596994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.597239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.597390 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.597539 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.597698 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.597844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.597984 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.598122 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.598271 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.598415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.598719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.598865 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.599029 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.599241 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.599394 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.599543 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.599701 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.599848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.599988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.600232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.600388 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.600538 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.600685 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.600830 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.600979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.601129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.601286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.601438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.601578 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.601727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.601865 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.602003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.602153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.602345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.602497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.602497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.602760 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.602909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.603068 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.603215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.603360 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.603509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.603659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.603797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.603948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.604105 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.604105 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.604396 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.604542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.604691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.604837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.604988 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.605194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.605355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.605529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.605686 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.605890 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.612644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.612806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.612806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.612806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.613246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.613399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.613541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.613698 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.613837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.613990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.614139 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.614290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.614429 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.614566 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.614714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.614875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.615015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.615159 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.615297 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.615446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.615639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.615796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.615947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.616146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.616319 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.616479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.616618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.616777 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.616952 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.617131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.617282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.617429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.617577 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.617725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.617876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.618024 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.618169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.618307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.618454 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.618607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.618607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.619012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.619158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.619304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.619556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.619712 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.619862 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.620025 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.620221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.620365 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.620551 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.620818 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.620964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.621114 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.621291 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.621499 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.621658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.621804 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.621950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.622107 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.622718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.622876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.623016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.623162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.623310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.623517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.623674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.623870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.624028 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.624373 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.624517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.624669 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.624810 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.624810 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.625194 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.625397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.625719 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.625869 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.626026 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.626205 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.626362 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.626509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.626648 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.626787 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.626933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.627081 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.627081 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.627458 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.627606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.627754 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.627907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.628055 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.628276 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.628474 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.628635 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.628854 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.628998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.629146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.629303 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.629450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.629635 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.629828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.630063 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.630294 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.630438 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.630609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.630789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.631100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.631279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.631488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.631675 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.631675 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.632119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.632279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.632279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.633342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.633486 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.633637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.633777 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.633923 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.634063 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.634063 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.634063 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.634519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.634715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.634870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.635010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.635157 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.635298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.635450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.635590 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.635741 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.635889 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.635889 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.636217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.636365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.636512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.636661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.636800 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.636952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 02:33:49.636952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.637313 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.637454 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.637594 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.637740 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.637887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.638046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.638046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.638311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.638466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.638606 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.638757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.638757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.639038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.639185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.639329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.639468 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.639468 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.639747 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.639894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.640033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.640211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.640211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.640596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.640744 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.640885 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.641023 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.641160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.641298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.641449 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.641587 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.641725 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.641870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.642010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.642148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.642312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.642451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.642684 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.642839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.643290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.643469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.643704 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.643858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.644012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.644205 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.644357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.644512 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.644671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.644818 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.644966 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.645115 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.645264 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.645416 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.645556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.645702 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.645840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.645994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.646141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.646289 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.646428 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.646576 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.646721 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.646867 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.647015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.647163 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.647304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.647450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.647588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.647735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.647887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.648034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.648207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.648355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.648503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.648642 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.648788 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.648937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.649085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.649232 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.649382 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.649530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.649678 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.649818 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.649978 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.650119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.650257 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.650421 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.650560 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.650700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.650837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.650983 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.651122 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.651273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.651413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.651550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.651687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.651824 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.651962 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.652184 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.652347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.652489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.652669 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.652891 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.653065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.653585 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.653828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.653974 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.654123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.654265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.654412 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.654552 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.654710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.654859 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.654998 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.655154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.655417 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.655562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.655708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.655847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.655985 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.656146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.656303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.656450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.656596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.656777 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.656922 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.657070 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.657229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.657368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.657543 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.657700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.657867 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.658032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.658174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.658313 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.658451 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.658601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.658752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.658901 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.659048 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.659188 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.659334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.659471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.659624 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.659773 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.659912 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.660090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.660239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.660390 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.660537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.660701 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.660849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.660995 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.661141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.661279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.661425 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.661572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.661710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.662176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.662323 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.662462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.662609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.662757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.662913 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.663154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.663324 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.663848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.664160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.664318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.664458 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.664597 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.664744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.664942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.665100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.665239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.665394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.665546 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.665546 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.665836 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.665976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.666116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.666262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.666262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.666262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.666262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.666262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.666262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.667854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.668144 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.668348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.668493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.668640 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.668778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.668916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.669072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.669223 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.669378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.669524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.669661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.669806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.669954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.670092 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.670245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.670385 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.670530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.670676 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.670837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.670984 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.671123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.671260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.671407 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.671554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.671705 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.671844 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.671989 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.672150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.672291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.672443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.672591 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.672748 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.672895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.673047 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.673275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.673275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.673275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.673275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.674247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.674406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.674406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.674681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.674829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.674968 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.675116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.675270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.675416 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.675632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.675781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.675922 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.676111 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.676258 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.676407 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.676549 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.676721 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.676899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.677086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.677242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.677389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.677536 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.677684 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.677832 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.677979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.678119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.678265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.678413 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.678559 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.678700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.678848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.679004 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.679152 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.679298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.679450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.679591 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.679741 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.679878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.680013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.680013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.680298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.680443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.680656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.680656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.680656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.681054 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.681188 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.681407 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.681542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.681682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.681818 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.681952 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.682086 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.682232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.682368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.682509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.682648 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.682792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.682937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.683082 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.683215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.683382 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.683511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.683665 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.684052 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.684438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.684582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.684714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.684850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.684987 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.685146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.685288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.685424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.685566 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.685710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.685924 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686205 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686339 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686616 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686765 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.686908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.687188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.687188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.687458 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.687606 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.687741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.687883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.688017 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.688173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.688309 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.688450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.688592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.688744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.688885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.689026 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.689169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.689317 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.689460 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.689600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.689734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.689870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.690011 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.690148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.690297 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.690432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.690647 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.690790 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.690933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.691074 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.691207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.691341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.691474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.691608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.691751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.691900 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.692042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.692203 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.692346 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.692502 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.692645 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.692787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.692919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693061 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693364 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693702 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693783 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.693783 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694358 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694625 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694798 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.694958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695300 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695477 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695558 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695638 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695725 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695819 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.695983 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.696121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.696252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.696378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.696528 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.696654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.696779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.696910 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.697039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.697162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.697355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.697538 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.697676 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.697811 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.697981 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.698109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.698247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.698382 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.698513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.698513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.698750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.698750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.699002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.699124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.699238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.699238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.699764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.699882 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.699993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.700950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.701425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.701594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.702112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.702241 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.702347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.702535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.702650 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.704003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.704736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.704932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.705105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.705276 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.705496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.705649 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.705854 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.706157 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.706311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.706489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.706699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.706849 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.707034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.707222 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.707380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.708369 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.708586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.708874 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.709145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.709415 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.709778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.710020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.710265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.710652 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.710983 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.711263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.711543 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.711839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.711999 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.712476 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.712476 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.712780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.712944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.713086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.714163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.717181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.718668 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.718668 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.719068 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.719274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.719475 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.719687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.719917 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.720233 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.720433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.720579 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.720707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.720832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.720972 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.721173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.721374 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.721560 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.721691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.721816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.721952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722344 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722478 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.722895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.723817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.723817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.723817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.724207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.724328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.724643 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.725154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.725357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.725581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.725901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.726220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.726521 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.726840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.727152 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.727465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.727795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.728131 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.728465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.728790 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.729123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.729458 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.729772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.730105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.730428 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.730758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.731128 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.731442 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.731793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.733872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.733991 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734281 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734579 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734670 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.734749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.735041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740097 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740224 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740726 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740888 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.740958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741027 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741178 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741461 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741776 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.741995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742065 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742202 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742337 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742414 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742491 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.742561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.743087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.743087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.743283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.743597 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.743918 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.744210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.744317 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.744573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.744894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.745102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.745207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.745514 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.745835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.746156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.746331 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.746762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.746971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.747089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.747404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.747712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.747820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.748031 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.748374 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.748582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.748697 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.748998 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.749321 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.749490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.749635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.749956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.750259 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.750366 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.750600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.750933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.751207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.751325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.751584 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.751905 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.752113 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.752251 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.752575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.752883 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.752999 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.753248 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.753560 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.753881 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.754122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.754228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.754508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.754825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.754982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.755166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.755448 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.755777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.756108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.756418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.756658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.756775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.757041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.757375 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.757567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.757714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.758044 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.758338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.758455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.758671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.758993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.759212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.759545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.759850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.759966 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.760220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.760554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.760759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.760879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.761196 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.761483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.761590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.761839 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.762201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.762407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.762511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.762817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.763135 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.763325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.763441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.763771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.764132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.764418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.764612 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.764740 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.765061 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.765373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.765612 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.765964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.766288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.766653 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.767162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.767345 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.767528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.767905 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.768128 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.768256 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.768567 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.768868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.768985 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.769183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.769511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.769746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.769866 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.770126 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.770436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.770622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.770750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.771070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.771367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.771483 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.771682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.771995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.772319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.772437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.772654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.772965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.773180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.773285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.773580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.773890 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.774199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.774405 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.774519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.774809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.775131 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.775249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.775438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.775755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.776082 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.776407 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.776547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.776726 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.777041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.777299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.777405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.777696 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.778012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.778289 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.778431 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.778651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.778967 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.779191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.779308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.779609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.779928 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.780125 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.780310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.780634 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.780891 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.781204 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.781518 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.781636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.781921 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.782266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.782374 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.782616 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.782932 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.783142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.783253 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.783555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.783887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.784178 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.784318 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.784543 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.784869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.785187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.785432 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.785537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.785809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.786120 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.786437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.786725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.786845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.787375 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.787723 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.787922 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.788046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.788385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.788680 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.788805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.789021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.789339 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.789661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.789837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.789958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.790284 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.790594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.790694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.790933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.791262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.791555 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.791654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.792001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.792345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.792510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.792668 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.792997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.793455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.793687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.793949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.794057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.794316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.794644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.794971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.795297 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.795649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.795799 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.795982 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.796354 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.796654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.796967 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.797279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.797580 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.797680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.797917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.798258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.798548 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.798662 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.798897 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.799216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.799502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.799611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.799848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.800200 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.800533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.800837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.800936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.801158 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.801499 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.801814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.802007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.802145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.802443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.802758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.803015 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.803121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.803378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.803709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.803990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.804120 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.804358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.804690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.805013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.805341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.805593 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.805706 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.805964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.806311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.806615 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.806937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.807212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.807312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.807559 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.807879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.808226 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.808562 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.808919 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.809260 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.809574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.809704 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.809984 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.810304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.810516 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.810655 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.810992 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.811256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.811374 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.811614 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.811925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.812163 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.812283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 02:33:49.812748 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.813240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.813980 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.814334 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.814941 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.815452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.815791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.816326 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.816697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.817860 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.818242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.818596 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.818948 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.819280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.819621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.819953 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.820400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.820746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.821081 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.821416 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.821741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.822080 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.822415 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.822946 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.823482 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.824193 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.824911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.825590 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.826157 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.826720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.827256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.827803 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.828474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.829715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.830249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.830843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.831381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.831927 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.832476 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.833005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.833614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.834223 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.834928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.835706 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.836319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.836872 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.837429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.837973 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.838721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.839266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.839818 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.840428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.840677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_db.sqlalchemy.engines [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:49.841231 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.841788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.842365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.842890 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.843429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.843978 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.844589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.845262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.846010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.846558 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.847106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.848043 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.848809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.849352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.850471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.851022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.851559 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.852110 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.852659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.853198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.853727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.854258 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.855490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.856143 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.856827 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.857487 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.858031 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.858650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.859176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.859707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.860325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.860864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.861417 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.862044 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.862598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.863157 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.863694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.864263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.864813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.865488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.866037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.866812 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.867344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.867877 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.868474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.869110 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.870286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.870844 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.871378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.872233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.872793 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.873334 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.873887 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.874414 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.874941 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.875588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.876172 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.876704 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.877577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.878564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.879357 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.881110 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.881667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.882230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.882822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.883554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.884121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.884710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.886452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.890439 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.890688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.891047 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.892096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.892096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.892266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.893952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.893952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.893952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.893952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.893952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.894311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.894541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.895284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.895284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.895567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.895874 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.896562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.896908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.897503 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.897840 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.898191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.898914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.899266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.899601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.900219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.900934 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.901361 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.901752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.902151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.902544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.902967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.903396 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.903788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.904199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.904700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.905027 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.905590 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.905959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.906290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.906808 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.907154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.907485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.907808 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.908198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.908645 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.908778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.context [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7(cell1) {{(pid=122781) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 02:33:49.909097 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.909437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.909761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.910086 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.910403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.910725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.911046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.911365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.911687 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.912338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.912678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.912996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.913311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.913655 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.913976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.914284 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:33:49.914397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.914596 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.914912 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.915224 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.915544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.915858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.916337 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.916436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:33:49.916530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.916858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.917177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.917291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:33:49.917495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.917811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.918544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.918544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.918938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.919277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.919603 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.919759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:33:49.919935 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.920286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.920634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.920994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.921325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.921909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.922306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.922643 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.923008 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.923361 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.923699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.924344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.924670 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.925008 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.925344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.926050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.926050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.926340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.926603 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.927154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.927689 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.928191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.928878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.929244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.929800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.930140 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.930474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.930807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.931142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.931467 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.931793 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.932147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.932478 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.932811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.933429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.933544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.933774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_db.sqlalchemy.engines [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:49.933914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.934279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.934606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.934936 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.935270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.935478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_db.sqlalchemy.engines [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:49.935579 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.935916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.936294 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.936622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.937014 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.937275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.937621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.937975 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.938314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.938654 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.938973 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.939443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.939786 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.940120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.940445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.940791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.941124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.941459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.941781 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.942116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.942437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.942768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.943099 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.943427 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.943746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.944104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.944430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.944751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.945182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.945505 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.945826 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.946147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.946484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.946824 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.947142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.947473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.947798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.948158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.948484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.948803 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.949147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.949494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.949875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.950204 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.950529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.950854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.951184 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.951522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.951856 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.952221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.952563 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.952918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.953239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.953610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.953948 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.954270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.954814 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.955137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 02:33:49.955388 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 02:33:49.978941 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_db.sqlalchemy.engines [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:50.045582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.context [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7(cell1) {{(pid=122782) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 02:33:50.049825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:33:50.051426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:33:50.052431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:33:50.054396 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:33:50.065376 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_db.sqlalchemy.engines [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:50.066183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_db.sqlalchemy.engines [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:50.098073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_db.sqlalchemy.engines [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:50.228103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_db.sqlalchemy.engines [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 02:33:50.525870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: WARNING keystonemiddleware.auth_token [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:33:50.532546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: WARNING keystonemiddleware.auth_token [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:33:50.658446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: WARNING keystonemiddleware.auth_token [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:33:50.665380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: WARNING keystonemiddleware.auth_token [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:33:50.754925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: WARNING keystonemiddleware.auth_token [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:33:50.760033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: WARNING keystonemiddleware.auth_token [None req-25c56869-e3eb-402c-88ef-223fe2787555 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:33:50.765457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b79d369c0 pid: 122781 (default app) Jan 17 02:33:50.886483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: WARNING keystonemiddleware.auth_token [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 02:33:50.891771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: WARNING keystonemiddleware.auth_token [None req-1643ce60-5a21-483c-84c6-784b3d0a81f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 02:33:50.897229 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b79d369c0 pid: 122782 (default app) Jan 17 02:34:28.570050 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-57912176", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "c18fcc35-fcf8-48a2-8d41-5a1f402e312e"}]}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:29.065003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] validate_networks() for [('c18fcc35-fcf8-48a2-8d41-5a1f402e312e', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:34:31.371204 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-104256789", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "97da4c82-5c36-47e9-8cea-2b4c9d79a703"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:31.538918 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:34:31.539958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:34:31.540623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:34:31.541197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:34:31.541754 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:34:31.565512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:31.575425 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:31.583878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:31.584677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:31.659668 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Getting quotas for project cd9ae723aff549fe8e80022cb0e77cb9. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:31.675199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Getting quotas for user 285013fbddcd4561b2dc4fd77570cb60 and project cd9ae723aff549fe8e80022cb0e77cb9. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:31.698456 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:34:31.710243 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:34:31.868177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] validate_networks() for [('97da4c82-5c36-47e9-8cea-2b4c9d79a703', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:34:31.875976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-088ca991-68a3-4e03-b433-690d65c10277 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.944089 Jan 17 02:34:31.877654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:34:31.902081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ad525f08-555b-48ae-b25f-bb4aa6d9ff29 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:31.907486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ad525f08-555b-48ae-b25f-bb4aa6d9ff29 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:32.307574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ad525f08-555b-48ae-b25f-bb4aa6d9ff29 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:32.330301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ad525f08-555b-48ae-b25f-bb4aa6d9ff29 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1213 microversion: 2.1 time: 0.446146 Jan 17 02:34:32.331273 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 2/2] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:31 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1213 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:33.347536 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e1d8db5b-f4b3-4900-83e9-0b99e3f57112 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:33.348412 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e1d8db5b-f4b3-4900-83e9-0b99e3f57112 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:33.494451 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e1d8db5b-f4b3-4900-83e9-0b99e3f57112 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:33.505733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e1d8db5b-f4b3-4900-83e9-0b99e3f57112 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1213 microversion: 2.1 time: 0.162587 Jan 17 02:34:33.511932 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 3/3] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:33 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:34.339960 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:34:34.340522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:34:34.340835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:34:34.341239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:34:34.341636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:34:34.372391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:34.374942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:34.376730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:34.385389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:34.447048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:34.464597 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for user d19dac2ccdf34b62bf4dc5b43c034648 and project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:34.489728 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:34:34.492913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:34:34.528695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:34.529906 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:34.542523 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:34.543969 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:34.546737 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:34.552748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:34.680992 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-606abb3f-e7d7-4fc1-b24f-e965f31df23c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.779974 Jan 17 02:34:34.681978 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 1/4] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:34:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 17 02:34:34.693520 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5f259508-91b4-43ec-81db-f275ef089811 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:34.694127 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5f259508-91b4-43ec-81db-f275ef089811 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:34.925511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5f259508-91b4-43ec-81db-f275ef089811 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:34.942183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5f259508-91b4-43ec-81db-f275ef089811 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1217 microversion: 2.1 time: 0.252342 Jan 17 02:34:34.943079 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 2/5] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:34 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1217 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:34.973439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:34.998038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5859a8e1-df06-4f28-9ca8-3a9bfc915c1f tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1217 microversion: 2.1 time: 0.473467 Jan 17 02:34:34.998764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 4/6] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:34 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1217 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:35.531502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7d3ff4ca-ce2e-4289-a950-14fe38e489e9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'create', calling method: .version_select at 0x7f074e9d9af0>, body: {"keypair": {"name": "tempest-keypair-113612085"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:35.606072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7d3ff4ca-ce2e-4289-a950-14fe38e489e9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:35.627162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7d3ff4ca-ce2e-4289-a950-14fe38e489e9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for user 8cb2f3ca95104ea3a8c5ca882908a454 and project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:35.960406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:35.960882 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:35.978360 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:35.978835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:35.981238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:35.987086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:36.251629 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:36.271579 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-25246858-594b-4693-ac7e-e8dae0dd8a78 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1221 microversion: 2.1 time: 0.316075 Jan 17 02:34:36.287314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 5/7] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:35 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1221 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:36.297973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:36.298367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7d3ff4ca-ce2e-4289-a950-14fe38e489e9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:36.298589 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:36.302434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7d3ff4ca-ce2e-4289-a950-14fe38e489e9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for user 8cb2f3ca95104ea3a8c5ca882908a454 and project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:36.310064 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:36.310729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:36.311742 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:36.312561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:36.326697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7d3ff4ca-ce2e-4289-a950-14fe38e489e9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.954650 Jan 17 02:34:36.327870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 3/8] 10.222.0.24 () {60 vars in 1157 bytes} [Mon Jan 17 02:34:35 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:36.570844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:36.583838 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a66bda9d-a3c9-4a24-9952-993bcc5ab190 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1217 microversion: 2.1 time: 0.293512 Jan 17 02:34:36.587156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 6/9] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:36 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1217 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:37.291165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:37.292418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:37.302982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:37.305706 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:37.311639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:37.312333 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:37.602469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:37.603655 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:37.620140 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:37.620844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:37.621785 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:37.622926 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:37.880919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:37.901769 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-496f9eb9-42e6-4ad8-b975-1d3f86656049 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1221 microversion: 2.1 time: 0.616783 Jan 17 02:34:37.903069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 4/10] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:37 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1221 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:37.932185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:37.944631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2a299823-a284-4bb4-ac9c-b0e1e2756acd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1217 microversion: 2.1 time: 0.345640 Jan 17 02:34:37.945828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 7/11] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:37 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1217 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:38.013889 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-236110315", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ada4a97e-feed-4797-83f8-f2534257b85a"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:38.101343 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] validate_networks() for [('ada4a97e-feed-4797-83f8-f2534257b85a', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:34:38.922968 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:38.924133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:38.934315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:38.934780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:38.935576 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:38.936006 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:39.083793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:39.096601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0ad3c412-9aa3-4cf2-bce0-b11a3acd915a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1221 microversion: 2.1 time: 0.180459 Jan 17 02:34:39.098039 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 8/12] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:38 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:39.110324 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:39.111218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:39.127795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:39.130236 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:39.133587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:39.135719 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:39.320097 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:39.335225 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e77c7b87-8ecd-4027-9304-2a1cda8e4fad tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1217 microversion: 2.1 time: 0.235173 Jan 17 02:34:39.345134 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 9/13] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:39 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:39.722461 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:34:39.722964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:34:39.723352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:34:39.723911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:34:39.724950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:34:39.745991 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:39.754772 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:39.755711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:39.756183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:39.818240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Getting quotas for project 21140fd2fa314c1abcf9aa4f51d2984e. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:39.836158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Getting quotas for user 8a1194d9f76740759a66514895eaf550 and project 21140fd2fa314c1abcf9aa4f51d2984e. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:39.877265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:34:39.879970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:34:39.970804 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-631b767e-5cce-49f6-b93e-b8dc7eb89af8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.066358 Jan 17 02:34:39.972014 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 5/14] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:34:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:34:39.982437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7a4455ed-190d-4cab-a37e-d2c08d45c657 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:39.983064 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7a4455ed-190d-4cab-a37e-d2c08d45c657 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:40.115329 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:40.116212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:40.125568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:40.128367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:40.130918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:40.131609 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:40.192706 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7a4455ed-190d-4cab-a37e-d2c08d45c657 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:40.200421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7a4455ed-190d-4cab-a37e-d2c08d45c657 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1221 microversion: 2.1 time: 0.222282 Jan 17 02:34:40.201006 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 10/15] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:39 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:40.352727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:40.353508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:40.368805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:40.373020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:40.378824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:40.379885 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:40.630401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:40.643407 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6dc7184c-b4e6-4f6a-a8df-bc03dd79a46e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1265 microversion: 2.1 time: 0.294592 Jan 17 02:34:40.670021 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:40.670582 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 11/16] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:40 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:40.713933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1538446203", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ada4a97e-feed-4797-83f8-f2534257b85a"}]}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:40.715689 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-50f652ae-dcf6-429f-adc7-a46cfcf32f50 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1269 microversion: 2.1 time: 0.603219 Jan 17 02:34:40.720630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 6/17] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:40 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1269 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:40.818922 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] validate_networks() for [('ada4a97e-feed-4797-83f8-f2534257b85a', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:34:41.694330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:41.695865 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:41.711822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:41.713700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:41.715527 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:41.717373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:42.194583 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:42.216782 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9f788cb1-a7b8-4dc7-8843-65cf7814a0e0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1271 microversion: 2.1 time: 0.524765 Jan 17 02:34:42.219062 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 7/18] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:41 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1271 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:42.234960 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:42.242522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:42.266586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:42.276925 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:42.288298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:42.289001 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:43.007454 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:43.018653 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-37812ae5-54dc-44d1-aeb6-737a43045017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1275 microversion: 2.1 time: 0.796665 Jan 17 02:34:43.019759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 8/19] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:42 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1275 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:43.570656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7a44c6be-0fd6-478d-b21d-cc766b97c965 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'create', calling method: .version_select at 0x7f074e121d30>, body: {"keypair": {"name": "tempest-keypair-434689752"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:43.603487 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7a44c6be-0fd6-478d-b21d-cc766b97c965 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:43.615302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7a44c6be-0fd6-478d-b21d-cc766b97c965 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for user b97e9255c61a4c9fb57f59fb657a46b8 and project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:44.424027 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7a44c6be-0fd6-478d-b21d-cc766b97c965 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:44.430507 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-7a44c6be-0fd6-478d-b21d-cc766b97c965 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for user b97e9255c61a4c9fb57f59fb657a46b8 and project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:44.465302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7a44c6be-0fd6-478d-b21d-cc766b97c965 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.444064 Jan 17 02:34:44.471519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 9/20] 10.222.0.24 () {62 vars in 1198 bytes} [Mon Jan 17 02:34:43 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1446 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 17 02:34:44.472479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-328864628", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f4113a4-05d7-438d-9847-b83e4f657878"}], "security_groups": [{"name": "tempest-securitygroup--1073971371"}], "key_name": "tempest-keypair-113612085", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:44.494257 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:34:44.494695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:34:44.495153 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:34:44.495596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:34:44.496012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:34:44.508671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:44.509125 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:44.509946 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:44.510385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:44.603826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Getting quotas for project 21140fd2fa314c1abcf9aa4f51d2984e. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:44.611903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Getting quotas for user 8a1194d9f76740759a66514895eaf550 and project 21140fd2fa314c1abcf9aa4f51d2984e. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:44.627613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:34:44.630406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:34:44.725763 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-60746fd6-0d4c-46d2-8f19-8f48aa8effba tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.050557 Jan 17 02:34:44.726469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 12/21] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:34:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 4052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:34:44.747899 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:44.782253 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:44.806064 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:44.808494 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:44.809541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:44.812601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:45.038357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:45.060547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] validate_networks() for [('0f4113a4-05d7-438d-9847-b83e4f657878', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:34:45.080835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-98d15763-d7ce-4563-92a8-772c361860f7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1271 microversion: 2.1 time: 0.350281 Jan 17 02:34:45.107631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 13/22] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:44 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1271 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:45.130283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:45.134077 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:45.159593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:45.160105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:45.164576 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:45.165033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:47.572642 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:47.588484 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d9814956-d4a3-401e-a7db-286883e5d93f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 2.478243 Jan 17 02:34:47.589174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 14/23] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:45 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:47.610644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:47.611343 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:47.623547 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:47.624516 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:47.625617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:47.626292 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:47.861334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:47.875591 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ce8e0fbf-1aa8-4ad5-9499-167f93eb09e6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1280 microversion: 2.1 time: 0.278518 Jan 17 02:34:47.885353 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 15/24] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:47 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:47.904310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:47.905025 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:47.930585 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:47.932118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:47.932596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:47.933358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:48.392801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:34:48.393920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:34:48.394401 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:34:48.394815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:34:48.395232 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:34:48.413448 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:48.417519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:48.418557 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:48.419011 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:48.485367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for project cf0621b37a7046b4be225145a729936f. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:48.509967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for user 8cb2f3ca95104ea3a8c5ca882908a454 and project cf0621b37a7046b4be225145a729936f. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:48.548156 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:34:48.550860 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:34:48.696345 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9500d68d-046d-41af-ac12-ecd41d31f55f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.222643 Jan 17 02:34:48.696813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 10/25] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:34:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 4230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:34:48.718036 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:48.726050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:48.764317 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:48.772653 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:48.774674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:48.776934 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:49.627160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:49.641015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2c9f51ea-281d-44f3-8cf3-1669891bb2d6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 1.753739 Jan 17 02:34:49.645487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 16/26] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:47 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:49.659129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:49.660033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:49.676320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:49.677358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:49.681083 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:49.681695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:50.662800 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:50.686716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a8cd4643-5015-48e4-9086-59e219748a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1240 microversion: 2.1 time: 1.038989 Jan 17 02:34:50.689186 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 17/27] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:49 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1240 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:50.706674 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:50.711809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:50.735307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:50.736040 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:50.737166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:50.740223 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:50.853883 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:50.868298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a782f002-d1ff-4bff-ba93-24d320aeccd8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 2.160982 Jan 17 02:34:50.870654 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 11/28] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:48 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:51.051284 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:51.067545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f055c65c-ddd0-4c87-9369-17d788fb185f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1280 microversion: 2.1 time: 0.371881 Jan 17 02:34:51.068602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 18/29] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:50 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1280 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:51.088685 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:51.091613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:51.101186 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:51.106403 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:51.110115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:51.111873 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:51.299106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-cca35ecb-0967-4d2b-9fd9-b52a25443ef7 req-c38579b1-e71e-445f-a377-7383a58f432c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ef95ec-9461-446c-ac23-d29814c0a4fa", "tag": "7ed6ad5d-11bb-4292-b0e7-ddace74a6459"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:51.301555 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:34:51.301555 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:34:51.325252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-cca35ecb-0967-4d2b-9fd9-b52a25443ef7 req-c38579b1-e71e-445f-a377-7383a58f432c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:51.327801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-cca35ecb-0967-4d2b-9fd9-b52a25443ef7 req-c38579b1-e71e-445f-a377-7383a58f432c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:51.373293 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-cca35ecb-0967-4d2b-9fd9-b52a25443ef7 req-c38579b1-e71e-445f-a377-7383a58f432c service nova] Creating event network-changed:7ed6ad5d-11bb-4292-b0e7-ddace74a6459 for instance 24ef95ec-9461-446c-ac23-d29814c0a4fa on hv-cinder-82160 Jan 17 02:34:51.374103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-cca35ecb-0967-4d2b-9fd9-b52a25443ef7 req-c38579b1-e71e-445f-a377-7383a58f432c service nova] Acquired lock "compute-rpcapi-router" {{(pid=122782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 17 02:34:51.377143 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6f6e2c9b-a2a9-4f50-8222-80691d91a068 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:51.378233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6f6e2c9b-a2a9-4f50-8222-80691d91a068 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:51.380768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6f6e2c9b-a2a9-4f50-8222-80691d91a068 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:51.382182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6f6e2c9b-a2a9-4f50-8222-80691d91a068 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:51.407689 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.compute.rpcapi [None req-6f6e2c9b-a2a9-4f50-8222-80691d91a068 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 17 02:34:51.411156 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6f6e2c9b-a2a9-4f50-8222-80691d91a068 None None] Releasing lock "compute-rpcapi-router" {{(pid=122782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 17 02:34:51.457547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6f6e2c9b-a2a9-4f50-8222-80691d91a068 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577912 Jan 17 02:34:51.458719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 12/30] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:34:51.716864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:51.718012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:51.727544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:51.730198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:51.733422 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:51.735239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:52.175441 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:52.190151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-53cf033b-95f0-406a-b29b-d09c82e5d1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1294 microversion: 2.1 time: 0.484010 Jan 17 02:34:52.200965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 13/31] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:51 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1294 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:52.225863 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:52.227548 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:52.244028 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:52.244672 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:52.245651 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:52.246843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:52.362077 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:52.369658 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7d30ee71-4a6b-4eed-b87d-b676c1216c1c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 1.290078 Jan 17 02:34:52.370274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 19/32] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:51 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:52.390639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:52.403956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:52.411131 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:52.411816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:52.412794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:52.414917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:53.364531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:53.372136 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d0c2c709-4e83-4ce5-aad2-cca3c85d1f60 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 1.177145 Jan 17 02:34:53.375476 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 14/33] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:52 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:53.397855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:53.407677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-55a4aea2-5895-410f-9716-e39e4548f6ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 1.020658 Jan 17 02:34:53.421453 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 20/34] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:52 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:53.426587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:53.427507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:53.453364 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:53.454341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:53.457228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:53.459219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:53.547479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-fd24c997-736c-4656-b2ff-6af846261d4b req-4b02b140-ad1b-47af-af1b-0b958da4032e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ede7e90-f5c5-49ed-9e17-ed43a35b8d41", "tag": "7b3a5764-34ba-43e6-9b3f-7d34a124a296"}, {"name": "network-changed", "server_uuid": "f21e2a65-a1ed-433d-92ef-fc11b3a1b233", "tag": "8442125d-91ba-4cc7-a1a2-404f0c258981"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:53.550971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:34:53.550971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:34:53.568803 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-fd24c997-736c-4656-b2ff-6af846261d4b req-4b02b140-ad1b-47af-af1b-0b958da4032e service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:53.572122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-fd24c997-736c-4656-b2ff-6af846261d4b req-4b02b140-ad1b-47af-af1b-0b958da4032e service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:53.610839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-fd24c997-736c-4656-b2ff-6af846261d4b req-4b02b140-ad1b-47af-af1b-0b958da4032e service nova] Creating event network-changed:7b3a5764-34ba-43e6-9b3f-7d34a124a296 for instance 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 on hv-cinder-82160 Jan 17 02:34:53.611622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-fd24c997-736c-4656-b2ff-6af846261d4b req-4b02b140-ad1b-47af-af1b-0b958da4032e service nova] Creating event network-changed:8442125d-91ba-4cc7-a1a2-404f0c258981 for instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 on hv-cinder-82160 Jan 17 02:34:53.627885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-fd24c997-736c-4656-b2ff-6af846261d4b req-4b02b140-ad1b-47af-af1b-0b958da4032e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.249538 Jan 17 02:34:53.630736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 15/35] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:34:53.640286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:53.641445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:53.653179 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:53.654010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:53.655193 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:53.656248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:54.044209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:54.059930 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-624700a0-9fbd-4b38-80fc-857ff247757f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1294 microversion: 2.1 time: 0.637043 Jan 17 02:34:54.069609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 21/36] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:53 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1294 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:54.389680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:54.390522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:54.407493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:54.407493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:54.408340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:54.408733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:55.084479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:55.105996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-29aed59e-cb98-49fa-9842-701444fe66b9 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 1.473470 Jan 17 02:34:55.106610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 16/37] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:53 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:55.111248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:55.118427 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:55.149874 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:55.156733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:55.157793 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:55.158380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:56.334031 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:56.348514 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9c4d14f5-7cd4-43ce-baf7-a23d8a69c059 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 1.960761 Jan 17 02:34:56.350062 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 22/38] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:54 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:56.355878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:56.356687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:56.377194 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:56.379228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:56.380344 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:56.380941 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:56.578416 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:56.594958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-36cb8a56-e793-4aac-94aa-d8806624b00e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 1.483563 Jan 17 02:34:56.597830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 17/39] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:55 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:56.610104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:56.612307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:56.629172 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:56.632571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:56.636426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:56.637909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:57.017744 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:57.025349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2b762630-ce53-43cf-9b12-fa150c2cdd0d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.425503 Jan 17 02:34:57.030608 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 18/40] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:56 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:57.044448 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-edca8c41-bf55-4ae5-92e8-171fc9de2ce2 req-b0c439ab-e244-4e60-b3ba-952d2d964f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48444f12-33bc-48b0-9407-d2ba0210bfae", "tag": "4dcac35f-9d74-46b5-b915-b246173a256f"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:57.048755 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:34:57.048755 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:34:57.066488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-edca8c41-bf55-4ae5-92e8-171fc9de2ce2 req-b0c439ab-e244-4e60-b3ba-952d2d964f40 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:57.068690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-edca8c41-bf55-4ae5-92e8-171fc9de2ce2 req-b0c439ab-e244-4e60-b3ba-952d2d964f40 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:57.080661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-edca8c41-bf55-4ae5-92e8-171fc9de2ce2 req-b0c439ab-e244-4e60-b3ba-952d2d964f40 service nova] Creating event network-changed:4dcac35f-9d74-46b5-b915-b246173a256f for instance 48444f12-33bc-48b0-9407-d2ba0210bfae on hv-cinder-82160 Jan 17 02:34:57.087122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-edca8c41-bf55-4ae5-92e8-171fc9de2ce2 req-b0c439ab-e244-4e60-b3ba-952d2d964f40 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054657 Jan 17 02:34:57.092084 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 19/41] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:34:57.216497 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:57.227367 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-03b492eb-82b7-47c3-bfe2-9b5ec73846ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.876051 Jan 17 02:34:57.228478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 23/42] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:56 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:57.370185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:57.371532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:57.383571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:57.384249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:57.385379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:57.386547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:57.554512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1022684961", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8338e3ec-35ae-45c9-9027-5a5ad4414b55"}], "security_groups": [{"name": "tempest-securitygroup--838638517"}], "key_name": "tempest-keypair-434689752", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:57.569933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:57.578037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-14b7ede2-7474-4ffd-b529-4330a941c20d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.214074 Jan 17 02:34:57.578884 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 20/43] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:57 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:57.614180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:57.614715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:57.621774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:57.622517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:57.623505 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:57.624304 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:57.713173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] validate_networks() for [('8338e3ec-35ae-45c9-9027-5a5ad4414b55', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:34:57.902403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:57.911281 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c327e254-0b61-482b-8a44-f6d00f96efa0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.300573 Jan 17 02:34:57.912234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 21/44] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:57 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:58.047115 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:58.047734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:58.054280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.054730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:58.055785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.056345 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:58.565171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:58.576809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-eca2d4c1-5686-4468-a0a8-196f2bef7f67 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.533488 Jan 17 02:34:58.577834 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 22/45] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:58 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:34:58.591636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:58.592534 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:58.599550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.600302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:58.601173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.601663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:58.607943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:34:58.609663 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:34:58.610756 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:34:58.611572 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:34:58.612669 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:34:58.622861 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.623860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:58.625040 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.625690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:58.662639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:34:58.668301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for user b97e9255c61a4c9fb57f59fb657a46b8 and project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:34:58.681704 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:34:58.683943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:34:58.745338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-48d9b2be-ef36-47eb-9876-9a09161a0d6c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.194705 Jan 17 02:34:58.746515 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 24/46] 10.222.0.24 () {62 vars in 1187 bytes} [Mon Jan 17 02:34:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 17 02:34:58.758587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:58.759305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:58.776051 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.776844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:58.780580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:58.781041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:59.010193 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:59.017626 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-26cdf535-d633-479d-85dc-b9c128ae51b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.438647 Jan 17 02:34:59.018201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 23/47] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:58 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:59.022457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0be85c1e-efa5-43e6-8639-b0b88d091ca3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:59.023022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0be85c1e-efa5-43e6-8639-b0b88d091ca3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:59.106056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0be85c1e-efa5-43e6-8639-b0b88d091ca3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:59.110037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:59.124082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0be85c1e-efa5-43e6-8639-b0b88d091ca3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:59.125923 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-486c3b37-07d1-4056-b5f2-77bffdc4df0d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.377561 Jan 17 02:34:59.126513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 25/48] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:58 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:59.131963 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0be85c1e-efa5-43e6-8639-b0b88d091ca3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:59.133962 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0be85c1e-efa5-43e6-8639-b0b88d091ca3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1281 microversion: 2.20 time: 0.114851 Jan 17 02:34:59.139110 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:34:59 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:34:59.140813 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:59.142076 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:59.152620 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:59.154862 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:59.155925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:59.157388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:59.163073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-40ee1033-e166-49c1-bc8a-e3748606ef63 req-bc065eef-1015-4d41-860e-b42a2a99d415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d7c373-a92e-48a3-8605-f8655cf5cba4", "tag": "33b46f70-f49c-41cd-8f07-0740b1f82d6b"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:34:59.169709 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:34:59.169709 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:34:59.181528 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-40ee1033-e166-49c1-bc8a-e3748606ef63 req-bc065eef-1015-4d41-860e-b42a2a99d415 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:59.182172 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-40ee1033-e166-49c1-bc8a-e3748606ef63 req-bc065eef-1015-4d41-860e-b42a2a99d415 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:59.201274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-40ee1033-e166-49c1-bc8a-e3748606ef63 req-bc065eef-1015-4d41-860e-b42a2a99d415 service nova] Creating event network-changed:33b46f70-f49c-41cd-8f07-0740b1f82d6b for instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 on hv-cinder-82160 Jan 17 02:34:59.240833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-40ee1033-e166-49c1-bc8a-e3748606ef63 req-bc065eef-1015-4d41-860e-b42a2a99d415 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087449 Jan 17 02:34:59.244031 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 25/50] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:34:59.594783 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:34:59.595660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:34:59.598540 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:59.603311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:59.604135 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:59.605365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:34:59.605933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:34:59.606072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d3870f0a-44a3-4ec8-b9a9-1d6475e096fe tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.478363 Jan 17 02:34:59.606900 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 26/51] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:59 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:34:59.839001 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:34:59.849433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c6bb267b-1a1e-434e-a2d4-03d8fe152c9e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.259291 Jan 17 02:34:59.850417 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 26/52] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:34:59 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:00.034705 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:00.035314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:00.042219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.042897 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:00.043852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.044556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:00.142949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:00.143857 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:00.150419 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.151979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:00.153032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.153656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:00.360816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:00.379589 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-804d4afa-1f8c-459c-b10b-dcaabb7c5127 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.348598 Jan 17 02:35:00.383039 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 27/53] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:00 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:00.393046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:00.398136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:00.409470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.411691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:00.413244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.413843 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:00.749151 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:00.757099 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:00.777483 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:00.780785 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b6e8b026-5fd3-4e65-99c3-9169d33015f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1333 microversion: 2.20 time: 0.394601 Jan 17 02:35:00.796549 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 28/54] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:00 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1333 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:00.801408 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:00.819824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:00.845148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.847493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:00.853462 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:00.853956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:01.023276 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:01.034199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dfa157f3-3990-4c33-92d2-b2146b095f49 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.895295 Jan 17 02:35:01.035503 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 27/55] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:00 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:01.048711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:01.049457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:01.057742 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:01.060660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:01.065455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:01.066003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:01.211949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:01.219572 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-08f985b5-5e4f-48c7-861a-3834a143b6c0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.421831 Jan 17 02:35:01.232863 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 29/56] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:00 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:01.371395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:01.379502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0732c381-8feb-4a07-9f4e-2b2c1235ddd4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.340889 Jan 17 02:35:01.380341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 28/57] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:01 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:01.398619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:01.399605 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:01.407964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:01.408809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:01.411496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:01.412120 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:01.591525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:01.598859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-88dc2c0f-ed01-43dc-89ca-c625eae24326 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.204066 Jan 17 02:35:01.599433 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 30/58] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:01 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:01.811202 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:01.812582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:01.840687 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:01.841703 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:01.842969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:01.843594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:01.935211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:01.947682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:01.949790 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:01.950957 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-69b73596-0345-4973-b963-329ab6589b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1339 microversion: 2.20 time: 0.148558 Jan 17 02:35:01.952089 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 29/59] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:01 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1339 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:02.051405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:02.052166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:02.058361 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.059110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.059957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.060490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.250302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:02.250905 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:02.263792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.264308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.266402 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.272541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.313175 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:02.326498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-18236bf5-7c6e-43ef-a599-a1fbf4932524 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.278053 Jan 17 02:35:02.329073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 31/60] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:02 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:02.398245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:02.399384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:02.411263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.411819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.414402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.416637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.583839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:02.593879 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b1de4733-7457-4486-b50a-95efb7f40df3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.347111 Jan 17 02:35:02.594982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 30/61] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:02 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:02.615447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:02.617145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:02.629735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.631421 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.632486 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.635733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.651060 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:02.661465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0ceec7f8-011e-4ccf-8853-dbbc9d8e7968 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.267880 Jan 17 02:35:02.664610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 32/62] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:02 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:02.950341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:02.955628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-666113ae-1706-4f1b-9da0-1101996fe937 req-51d24230-e5a4-4b91-88d3-f00cc8675943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e3840c-9200-4dfe-8879-42d7cd878ec1", "tag": "c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:02.957843 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:02.957843 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:35:02.959796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-377ee450-fa35-4a4f-b7fa-645e119885f5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.348719 Jan 17 02:35:02.960621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 31/63] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:02 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:02.976055 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:02.976691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:02.978733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-666113ae-1706-4f1b-9da0-1101996fe937 req-51d24230-e5a4-4b91-88d3-f00cc8675943 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.979197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-666113ae-1706-4f1b-9da0-1101996fe937 req-51d24230-e5a4-4b91-88d3-f00cc8675943 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.987455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.988191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:02.990349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:02.991937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.005385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-666113ae-1706-4f1b-9da0-1101996fe937 req-51d24230-e5a4-4b91-88d3-f00cc8675943 service nova] Creating event network-changed:c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a for instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 on hv-cinder-82160 Jan 17 02:35:03.006701 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-666113ae-1706-4f1b-9da0-1101996fe937 req-51d24230-e5a4-4b91-88d3-f00cc8675943 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122781) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 17 02:35:03.008522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89e99833-5782-4476-b304-0d49525b0764 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.009351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89e99833-5782-4476-b304-0d49525b0764 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.010528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89e99833-5782-4476-b304-0d49525b0764 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.011385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89e99833-5782-4476-b304-0d49525b0764 None None] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.021889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.compute.rpcapi [None req-89e99833-5782-4476-b304-0d49525b0764 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 17 02:35:03.023616 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89e99833-5782-4476-b304-0d49525b0764 None None] Releasing lock "compute-rpcapi-router" {{(pid=122781) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 17 02:35:03.058816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-89e99833-5782-4476-b304-0d49525b0764 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106857 Jan 17 02:35:03.060045 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 33/64] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:35:03.237557 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:03.246235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:03.248531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:03.249709 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a0cebbd9-5a36-4845-adb7-ac323bd6557a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.278556 Jan 17 02:35:03.250474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:02 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:03.345185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:03.345879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:03.352886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.353487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.354512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.355145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.517104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:03.525940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0d523e16-2285-4e3c-8665-66f5b9c5d1d0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.184727 Jan 17 02:35:03.526570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 34/66] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:03 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:03.611123 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:03.611727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:03.618546 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.619212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.621633 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.621633 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.681183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:03.681815 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:03.695203 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.700577 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.701773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.702626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.862451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:03.871171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-af8669fd-5b61-485b-84cd-c9381a5170f5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.264083 Jan 17 02:35:03.879520 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 33/67] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:03 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:03.927221 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:03.952032 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-bb265f3c-1627-4135-b4c9-546f452c3884 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.277508 Jan 17 02:35:03.952828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 35/68] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:03 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:03.977290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:03.980746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:03.992765 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.993190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:03.997546 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:03.997998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.195244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:04.205145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5bf88b3a-5f18-462b-850c-f385d4c296f9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.232042 Jan 17 02:35:04.206269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 34/69] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:03 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:04.271570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:04.272169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:04.279600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.280049 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.282441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.284215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.453119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:04.462916 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:04.464639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:04.465981 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e894cd0c-5f61-4800-96ac-044c7edd5cec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.198094 Jan 17 02:35:04.467065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:04 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:04.542624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:04.543233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:04.549944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.550437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.551457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.552109 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.693541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:04.698967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-712dc3bf-7a02-46b9-a29b-50eaa00c6f9f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.160024 Jan 17 02:35:04.699535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 35/71] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:04 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:04.895427 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:04.896041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:04.902172 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.902628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.903415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.903852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.973256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:04.973853 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:04.980033 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.980751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:04.981524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:04.981957 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:05.072246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:05.079349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-478071e2-6afe-40be-8f3e-62540784e88c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.187535 Jan 17 02:35:05.080417 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 37/72] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:04 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:05.146276 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:05.153847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-32a3eca0-f4b0-441d-a84f-0798a99e13f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.184439 Jan 17 02:35:05.154387 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 36/73] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:04 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:05.222138 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:05.222933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:05.229441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:05.229893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:05.230679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:05.231136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:05.389169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:05.396848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-81dfa4be-de81-4061-8cac-d90aac254c64 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.178519 Jan 17 02:35:05.397418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 38/74] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:05 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:05.484315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:05.484921 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:05.490918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:05.491370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:05.492567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:05.493000 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:05.649426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:05.662020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:05.663967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:05.665162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c026cf1e-f9ff-4b4d-8391-197084de993c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.184580 Jan 17 02:35:05.665722 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 37/75] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:05 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:35:05.723917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:05.724581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:05.730646 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:05.731309 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:05.732332 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:05.732768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:05.876390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:05.884714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e25257b1-2875-4a81-a772-0f4a11684f4b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.171612 Jan 17 02:35:05.885308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 39/76] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:05 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:06.097231 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:06.097765 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:06.104214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.104772 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.105594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.106036 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.170807 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:06.171587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:06.178544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.179230 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.179985 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.180627 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.276222 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:06.285843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-681e002b-cc26-43b9-8847-47878394bcc6 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.192001 Jan 17 02:35:06.286739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 38/77] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:06 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:06.345135 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:06.353353 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8ca171aa-12ed-4d32-8510-5955cb5e5a46 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.186675 Jan 17 02:35:06.354130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 40/78] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:06 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:06.414146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:06.414757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:06.421329 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.421759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.422551 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.422990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.574569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:06.582389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2ce8c98c-1eb1-4e4d-9791-d1d1e00da42f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.172257 Jan 17 02:35:06.583150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 39/79] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:06 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:06.682690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:06.683378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:06.689455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.690124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.691072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.691682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.849532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:06.859914 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:06.861679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:06.862936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cd14dbbe-35d9-459b-bd97-bede2ea47cd9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.184091 Jan 17 02:35:06.863509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 41/80] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:06 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:06.901341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:06.902017 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:06.908200 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.908675 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:06.909481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:06.909940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.038639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:07.046473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-84b786f4-6567-47e1-882a-d3d03586a807 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.149150 Jan 17 02:35:07.047049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 40/81] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:06 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:07.302698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:07.303304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:07.310339 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.310793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.311638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.312160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.379234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:07.380284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:07.389736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.390518 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.391588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.392216 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.515040 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:07.523043 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b677954a-dbae-4591-a175-b34f2bb75309 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.224187 Jan 17 02:35:07.523629 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 42/82] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:07 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:07.570071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:07.577581 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fb5c3d3a-659f-41e5-baa7-0459b7b55e4d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.206056 Jan 17 02:35:07.578149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 41/83] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:07 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:07.599224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:07.599909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:07.607148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.607633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.608401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.608980 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.740689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:07.748909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-edfac322-2034-4805-9659-3763aa3b2159 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.153675 Jan 17 02:35:07.749485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 43/84] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:07 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:07.881564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:07.882351 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:07.891913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.892596 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:07.894143 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:07.897378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.048677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:08.057632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:08.058893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:08.060533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-32630f57-f986-43ad-818f-d74abeefcabf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.183522 Jan 17 02:35:08.061275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 42/85] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:07 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:08.064588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:08.065298 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:08.071172 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.071626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.072533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.073019 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.225631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:08.233689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-392b95ca-bbb2-49d7-b583-4ca91d1183b4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.174450 Jan 17 02:35:08.234710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 44/86] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:08 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:08.540662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:08.541277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:08.547595 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.548054 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.548874 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.549309 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.593865 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:08.594473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:08.600363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.604132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.605212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.605847 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.815457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:08.824346 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c8ea9deb-b786-453e-aa87-7f4e7fd607ac tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.287792 Jan 17 02:35:08.824963 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 43/87] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:08 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:08.830111 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:08.830899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:08.841324 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.841851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.842747 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:08.843201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:08.854304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:08.862626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b49fc1e8-862f-4371-aa56-670f6737160c tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.272188 Jan 17 02:35:08.863271 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 45/88] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:08 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:09.001795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:09.009065 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c570f511-b121-4af5-9ac0-e79f3ee1aefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.183121 Jan 17 02:35:09.009628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 44/89] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:08 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:09.079129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:09.079816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:09.085870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.086387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:09.087228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.087725 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:09.231187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:09.239864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:09.248605 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:09.249817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d8a7828c-87e8-490d-bb32-b67b6c3d8e7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.174558 Jan 17 02:35:09.250799 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 46/90] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:09 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:09.251353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:09.251968 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:09.260411 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.261014 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:09.261824 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.262279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:09.424355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:09.431760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-38216921-b433-4569-bf0f-a1b6e0036fe6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.184790 Jan 17 02:35:09.432469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 45/91] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:09 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:09.840762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:09.841622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:09.850393 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.850840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:09.851672 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.852127 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:09.879725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:09.880923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:09.892410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.893268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:09.898724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:09.899465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:10.038901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:10.048889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4e1f4ce7-cf92-464e-a159-482752749c07 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.211746 Jan 17 02:35:10.049738 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 47/92] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:09 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:10.063990 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:10.065377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:10.072268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:10.072973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:10.073987 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:10.074417 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:10.097915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:10.106376 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f06f1365-ab30-4bf1-a249-a98d317e1646 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.231438 Jan 17 02:35:10.115911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 46/93] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:09 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:10.212316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:10.219937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-65aec4b2-3f85-4a5e-bcf5-5fa842c6a1ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.159833 Jan 17 02:35:10.220530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 48/94] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:10 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:10.272613 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:10.273217 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:10.282545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:10.283226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:10.284026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:10.284565 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:10.448469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:10.449346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:10.457218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:10.457665 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:10.458669 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:10.459194 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:10.638371 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:10.647550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:10.652366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:10.652366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e754f2ac-1b66-457f-9d1a-fd16e5a4773f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.386775 Jan 17 02:35:10.652366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 47/95] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:10 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:10.729381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:10.736824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-be9033a8-c56c-4d40-aa00-085b8f5ccc72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.291948 Jan 17 02:35:10.737392 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 49/96] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:10 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:11.066459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:11.067289 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:11.075009 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.075787 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.077030 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.077733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.124765 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:11.126439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:11.133911 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.134708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.135777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.136564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.254269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:11.268519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dd0b5ed5-2c86-43ff-984b-acaf818e76a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.205564 Jan 17 02:35:11.269568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 48/97] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:11 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:11.274355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:11.275855 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:11.282533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.283168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.284197 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.284776 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.337602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:11.344975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3c1aac44-49f3-4886-9f41-024297db4fa3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.225480 Jan 17 02:35:11.354402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 50/98] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:11 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:11.437674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:11.446394 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-78a536c2-d68e-4052-8774-1c21bffa1388 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.175654 Jan 17 02:35:11.447072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 49/99] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:11 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:11.668756 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:11.669762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:11.675679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.676156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.677025 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.677440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.753657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:11.754570 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:11.762211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.763017 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.764564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:11.765231 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:11.840154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:11.851215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:11.853206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:11.854598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-04c08c6b-2043-40ea-b0be-d47527ef2ac7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.189540 Jan 17 02:35:11.855556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 51/100] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:11 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:11.938094 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:11.946386 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-16170cab-bb69-4179-8a67-f3fc98bd7627 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.195617 Jan 17 02:35:11.956191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 50/101] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:11 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:12.285850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:12.286775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:12.297507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.297961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.298757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.299193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.363964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:12.365276 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:12.376592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.377317 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.378448 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.378885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.537399 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:12.545380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-85d8b4b3-2c89-4654-9625-9d64f25265fa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.263423 Jan 17 02:35:12.546244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 52/102] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:12 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:12.550780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:12.551627 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:12.557595 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.558116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.558962 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.559458 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.590796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:12.599215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7f93a40b-3987-4c8d-ab5d-637a2847e747 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.240695 Jan 17 02:35:12.605413 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 51/103] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:12 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:12.730037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:12.739187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3f4d3944-8cbc-4721-ad9d-ec14aa86f635 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.191680 Jan 17 02:35:12.740370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 53/104] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:12 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:12.872181 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:12.872795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:12.882412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.883270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.884311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.884747 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.962925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:12.963908 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:12.970871 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.971687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:12.972793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:12.973443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.070468 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:13.083412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:13.086025 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:13.087124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fb871f8a-726c-42bc-b47e-974a00314d08 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.219030 Jan 17 02:35:13.087671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 52/105] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:12 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:13.188978 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:13.198302 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2a2077bb-7840-421d-8587-0bc2c08fa029 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.239085 Jan 17 02:35:13.199049 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 54/106] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:12 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:13.518998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-dfcf55e6-cfe9-4256-bca8-f36e2913ab77 req-3a0afa65-7f08-4875-be77-a55a8a2b7aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48444f12-33bc-48b0-9407-d2ba0210bfae", "name": "network-vif-plugged", "status": "completed", "tag": "4dcac35f-9d74-46b5-b915-b246173a256f"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:13.521372 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:13.521372 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:35:13.529014 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-dfcf55e6-cfe9-4256-bca8-f36e2913ab77 req-3a0afa65-7f08-4875-be77-a55a8a2b7aa5 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:13.529921 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-dfcf55e6-cfe9-4256-bca8-f36e2913ab77 req-3a0afa65-7f08-4875-be77-a55a8a2b7aa5 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.544420 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-dfcf55e6-cfe9-4256-bca8-f36e2913ab77 req-3a0afa65-7f08-4875-be77-a55a8a2b7aa5 service nova] Creating event network-vif-plugged:4dcac35f-9d74-46b5-b915-b246173a256f for instance 48444f12-33bc-48b0-9407-d2ba0210bfae on hv-cinder-82160 Jan 17 02:35:13.550375 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-dfcf55e6-cfe9-4256-bca8-f36e2913ab77 req-3a0afa65-7f08-4875-be77-a55a8a2b7aa5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088415 Jan 17 02:35:13.552008 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 53/107] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:13.562636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:13.563265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:13.570690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:13.571246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.572128 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:13.572774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.618757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:13.619667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:13.631724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:13.632564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.633697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:13.634323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.844707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:13.863217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4adb1352-44f0-477b-a1df-27983d5fde0f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.305586 Jan 17 02:35:13.863785 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 55/108] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:13 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:13.868281 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:13.878661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:13.887611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:13.889486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.891940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:13.892574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:13.927325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:13.946293 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-701dea4a-ef98-44ad-a8d3-63c0eb80b126 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.331726 Jan 17 02:35:13.947319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 54/109] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:13 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:14.101104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:14.112344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:14.112654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f7483a6c-b7e7-40b1-98bb-1762893b1335 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.247625 Jan 17 02:35:14.113264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:14.113700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 56/110] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:13 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:14.121904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.123495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:14.125281 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.125783 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:14.215652 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:14.216366 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:14.233771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.234439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:14.235617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.236367 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:14.421233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:14.434003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:14.436009 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:14.438171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-17622c4c-dd42-4835-ba7c-465cec6ca346 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.329964 Jan 17 02:35:14.446037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 55/111] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:14 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:14.447272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:14.455364 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a9b2c0fc-1c78-4774-9a32-d699307396eb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.244243 Jan 17 02:35:14.459214 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 57/112] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:14 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:14.881078 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:14.882452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:14.896650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.896650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:14.896650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.896650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:14.962564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:14.963680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:14.970798 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.971335 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:14.972258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:14.972781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.084669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:15.094766 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c62677cc-3cff-4eb0-a448-8adbd0e64ceb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.217844 Jan 17 02:35:15.103706 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 56/113] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:14 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:15.129944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:15.130895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:15.140533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:15.141288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.143124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:15.144722 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.176223 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:15.188710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2fcabfb3-5fa4-46b5-a1b0-422621927f66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.225595 Jan 17 02:35:15.189336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 58/114] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:14 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:15.341563 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:15.351706 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2ce024a4-2d46-4aaf-9f76-399436d34cb9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.225397 Jan 17 02:35:15.373322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 57/115] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:15 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:15.465168 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:15.465852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:15.473775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:15.475786 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.478929 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:15.479889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:15.480441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.481287 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:15.503606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:15.508163 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.509195 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:15.510365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.744203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:15.747366 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:15.753586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fb0f2e29-69e5-48e2-9676-f8f4a54b6d70 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.284007 Jan 17 02:35:15.756804 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:15.758291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:15.759391 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fd039c76-626e-4c03-9834-469ad8a6c530 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.299047 Jan 17 02:35:15.759937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 59/116] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:15 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:15.769842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 58/117] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:15 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:15.769842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ede7e90-f5c5-49ed-9e17-ed43a35b8d41", "name": "network-vif-plugged", "status": "completed", "tag": "7b3a5764-34ba-43e6-9b3f-7d34a124a296"}, {"server_uuid": "f21e2a65-a1ed-433d-92ef-fc11b3a1b233", "name": "network-vif-plugged", "status": "completed", "tag": "8442125d-91ba-4cc7-a1a2-404f0c258981"}, {"server_uuid": "c3d7c373-a92e-48a3-8605-f8655cf5cba4", "name": "network-vif-plugged", "status": "completed", "tag": "33b46f70-f49c-41cd-8f07-0740b1f82d6b"}, {"server_uuid": "d7e3840c-9200-4dfe-8879-42d7cd878ec1", "name": "network-vif-plugged", "status": "completed", "tag": "c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a"}, {"server_uuid": "24ef95ec-9461-446c-ac23-d29814c0a4fa", "name": "network-vif-plugged", "status": "completed", "tag": "7ed6ad5d-11bb-4292-b0e7-ddace74a6459"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:15.770369 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:15.770369 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:35:15.779379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:15.779834 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:15.800435 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Creating event network-vif-plugged:7b3a5764-34ba-43e6-9b3f-7d34a124a296 for instance 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 on hv-cinder-82160 Jan 17 02:35:15.800949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Creating event network-vif-plugged:8442125d-91ba-4cc7-a1a2-404f0c258981 for instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 on hv-cinder-82160 Jan 17 02:35:15.801432 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Creating event network-vif-plugged:33b46f70-f49c-41cd-8f07-0740b1f82d6b for instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 on hv-cinder-82160 Jan 17 02:35:15.801914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Creating event network-vif-plugged:c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a for instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 on hv-cinder-82160 Jan 17 02:35:15.802807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] Creating event network-vif-plugged:7ed6ad5d-11bb-4292-b0e7-ddace74a6459 for instance 24ef95ec-9461-446c-ac23-d29814c0a4fa on hv-cinder-82160 Jan 17 02:35:15.814201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-d7b0ca82-6382-4253-b5b7-ada87490114b req-8e1564f7-cc85-456c-bc19-235aaba7f200 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.049262 Jan 17 02:35:15.815682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 59/118] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:16.110553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:16.111162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:16.117320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.117776 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.118553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.118983 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.208522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:16.210633 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:16.219940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.220941 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.222264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.223015 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.310794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:16.323085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-10545bf3-4389-4068-9748-100c4fcc9cc7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1322 microversion: 2.1 time: 0.216038 Jan 17 02:35:16.324692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 60/119] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:16 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:16.377012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:16.381884 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:16.401095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.402967 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.406176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.407450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.475899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:16.494363 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f1426051-9bbc-4d3b-a9df-fa572397cd1d tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.288147 Jan 17 02:35:16.496590 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 60/120] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:16 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:16.700157 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:16.707421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-efa6529f-efb4-4fff-881a-82bf12fefb29 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.340502 Jan 17 02:35:16.707985 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 61/121] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:16 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:16.771088 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:16.771768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:16.777254 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:16.777861 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:16.777959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.778389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.779162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.779601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.786601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.787051 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.787835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:16.788301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:16.993733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:16.994431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:17.013671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2e49f99d-bc7c-4e18-ae98-2247e77e8b75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.246684 Jan 17 02:35:17.014452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 61/122] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:16 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:17.038806 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:17.040423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:17.041621 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1b14c379-4f63-4a7f-b3f2-c775e17c286f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.268122 Jan 17 02:35:17.042143 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 62/123] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:16 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:17.342682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:17.342682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:17.347145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.348430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.349976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.350499 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.498040 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:17.505600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2f8a7d7c-9dc4-4c72-bb1b-13ae0a3e5683 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1516 microversion: 2.1 time: 0.169749 Jan 17 02:35:17.506179 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 62/124] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:17 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:17.513825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:17.514731 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:17.521679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.522124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.523061 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.523313 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:17.523802 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.524392 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:17.530902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.531457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.533530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.533982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.596873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lazy-loading 'flavor' on Instance uuid 48444f12-33bc-48b0-9407-d2ba0210bfae {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:35:17.661931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:17.670590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7d45ec14-c1b3-4f8e-a1d9-498acfe3eaa0 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.160415 Jan 17 02:35:17.671179 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 63/125] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:17 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:17.724355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:17.725018 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:17.731282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.731724 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.732529 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.732956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.733407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0c227789-3544-41a8-8d27-17d2c269c718 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae/action" status: 200 len: 32 microversion: 2.1 time: 0.213804 Jan 17 02:35:17.734169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 63/126] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:17 2022] POST /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:17.743768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:17.745042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:17.751850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.752478 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.753391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:17.754012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:17.916890 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:17.927388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dfb3e4f0-3871-4dc1-8f61-efd709251daa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.206895 Jan 17 02:35:17.927972 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 64/127] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:17 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:17.956741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:17.971727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5046e41d-f9ac-4122-acfa-9bc4d70fdc35 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.232044 Jan 17 02:35:17.972682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 64/128] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:17 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:18.030869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:18.031718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:18.039094 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.039472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.040304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.040769 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.059493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:18.060316 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:18.066204 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.066651 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.067430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.067858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.187826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:18.201022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a45ea807-2de1-4da2-8679-666a3afc2187 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.174166 Jan 17 02:35:18.201778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 65/129] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:18 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:18.397735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:18.407282 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:18.409071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:18.410812 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ebf2e307-5302-402b-a299-ce85720d4ae5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.354910 Jan 17 02:35:18.411550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 65/130] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:18 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:18.689146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:18.689754 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:18.696476 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.696920 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.697707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.700006 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.849883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:18.862968 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b698a750-f534-4097-b586-cbbfdfebdbb1 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.177348 Jan 17 02:35:18.863721 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 66/131] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:18 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:18.944193 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:18.945005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:18.951864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.952485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.953428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:18.953996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:18.990245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:18.990952 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:19.006099 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.006609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:19.007484 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.007973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:19.289489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:19.300792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2a951a67-593f-4684-b612-d7d6d0108c08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.360239 Jan 17 02:35:19.301846 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 66/132] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:18 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:19.307051 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:19.308042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:19.316425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.317174 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:19.318177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.318809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:19.373686 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:19.381917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5f0ca64e-75f4-4b08-92e4-47cb89fee3b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.395806 Jan 17 02:35:19.399047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 67/133] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:18 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:19.429335 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:19.429995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:19.437810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.440578 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:19.441805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.445276 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:19.686884 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:19.695145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-69ced8db-36f3-414e-9e4b-654e5726a58d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.391781 Jan 17 02:35:19.695729 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 67/134] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:19 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:19.737926 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:19.749016 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:19.750498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:19.751598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9d9668d7-6fe1-4790-ad2b-8ea662b54ad5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.326292 Jan 17 02:35:19.752502 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 68/135] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:19 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:19.880047 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:19.880567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:19.889530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.890255 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:19.891134 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:19.891731 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.249059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:20.256858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d55af52b-a3cc-4ca7-b3ac-8b01d108c4a4 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1313 microversion: 2.1 time: 0.380679 Jan 17 02:35:20.257582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 68/136] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:19 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:20.317873 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:20.318457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:20.324913 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.325361 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.326261 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.326569 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.404444 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:20.405067 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:20.413099 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.413604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.414624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.415256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.497745 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:20.505607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e69d4d1b-cc1a-4df4-b905-e55ed6c133f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.191340 Jan 17 02:35:20.506373 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 69/137] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:20 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:20.585588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:20.594022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4fd3f3b2-19ad-4ede-85cb-57d2d41b52f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.196162 Jan 17 02:35:20.594778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 69/138] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:20 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:20.711906 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:20.712530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:20.720032 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.720032 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.720032 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.720674 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.770226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:20.770773 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:20.776870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.777332 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.778130 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:20.778562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:20.917477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:20.924693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1ee62217-744d-4fb4-a56d-e201d66b151a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1317 microversion: 2.1 time: 0.216471 Jan 17 02:35:20.925263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 70/139] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:20 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:20.973105 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:20.980999 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:20.982483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:20.983579 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8f8f7981-ce86-4fd7-993d-0ac34552c92d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1406 microversion: 2.20 time: 0.217537 Jan 17 02:35:20.984177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 70/140] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:20 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:35:21.274888 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:21.275425 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:21.281359 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.281798 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:21.282567 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.282998 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:21.420731 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:21.428720 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fae96f30-cd89-40e3-a8a3-aa5fb971d25a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1500 microversion: 2.1 time: 0.157871 Jan 17 02:35:21.429289 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 71/141] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:21 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:21.522623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:21.523644 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:21.530612 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.531613 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:21.532621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.533196 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:21.614129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:21.614987 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:21.626245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.626968 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:21.628002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.628580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:21.759780 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:21.768708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-46dc47ff-3bd0-46ac-8e43-6d616e7c29e0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1362 microversion: 2.1 time: 0.249706 Jan 17 02:35:21.773811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 71/142] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:21 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:21.880010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:21.888554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2998f3dc-ce6e-433d-8a1f-c60cbb3b7abf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.279475 Jan 17 02:35:21.897544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 72/143] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:21 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:21.940881 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:21.941470 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:21.956719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.957184 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:21.958048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:21.958484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.001645 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:22.002355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:22.008370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.008821 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.009601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.010028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.201935 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:22.221940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8dc5a2e7-0110-4540-852f-036619ceb990 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1507 microversion: 2.1 time: 0.284726 Jan 17 02:35:22.222571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 72/144] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:21 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:22.223384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:22.231575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:22.233106 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:22.234242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7b945b33-ec57-4df4-8264-56c0ad77cd51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1599 microversion: 2.20 time: 0.236428 Jan 17 02:35:22.235502 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 73/145] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:35:21 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1599 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:35:22.255211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e6ec7b57-30fc-4869-9ff7-6f6a437d0682 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:22.256526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e6ec7b57-30fc-4869-9ff7-6f6a437d0682 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:22.262471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6ec7b57-30fc-4869-9ff7-6f6a437d0682 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.263024 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6ec7b57-30fc-4869-9ff7-6f6a437d0682 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.264058 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6ec7b57-30fc-4869-9ff7-6f6a437d0682 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.264750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6ec7b57-30fc-4869-9ff7-6f6a437d0682 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.358868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e6ec7b57-30fc-4869-9ff7-6f6a437d0682 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108339 Jan 17 02:35:22.359498 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 73/146] 10.222.0.24 () {60 vars in 1315 bytes} [Mon Jan 17 02:35:22 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:35:22.786875 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:22.787464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:22.798112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.798551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.799339 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.799761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.922447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:22.923045 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:22.930293 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.931042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:22.932042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:22.932819 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:23.440801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:23.448559 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6a638da7-0ad5-403c-bf0f-cc8e4e079693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1548 microversion: 2.1 time: 0.665492 Jan 17 02:35:23.449318 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 74/147] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:22 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1548 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:23.465293 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-439b7b29-054d-44f7-802b-09543dba5ad5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:23.465764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-439b7b29-054d-44f7-802b-09543dba5ad5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:23.472142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-439b7b29-054d-44f7-802b-09543dba5ad5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:23.472568 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-439b7b29-054d-44f7-802b-09543dba5ad5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:23.473580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-439b7b29-054d-44f7-802b-09543dba5ad5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:23.474177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-439b7b29-054d-44f7-802b-09543dba5ad5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:23.517166 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:23.528564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c0faeb91-076f-4c1e-a178-53726d3c0ddc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.608327 Jan 17 02:35:23.533741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 74/148] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:22 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:23.629132 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-330763e7-bea7-403d-8085-4cb8f73e1161 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "669b664a-3474-43bd-b32c-c908cb5ca1ba"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:23.630628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-330763e7-bea7-403d-8085-4cb8f73e1161 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:23.636931 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330763e7-bea7-403d-8085-4cb8f73e1161 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:23.637379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330763e7-bea7-403d-8085-4cb8f73e1161 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:23.638219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330763e7-bea7-403d-8085-4cb8f73e1161 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:23.638646 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330763e7-bea7-403d-8085-4cb8f73e1161 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:23.662943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-439b7b29-054d-44f7-802b-09543dba5ad5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201123 Jan 17 02:35:23.664265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 75/149] 10.222.0.24 () {58 vars in 1274 bytes} [Mon Jan 17 02:35:23 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:35:23.994324 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1413e8e9-da80-4e71-b631-31fd47e962bd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62a9d4e9-81db-4cdd-8e36-dec414bb2fb0"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:23.996004 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1413e8e9-da80-4e71-b631-31fd47e962bd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:24.005382 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1413e8e9-da80-4e71-b631-31fd47e962bd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:24.005979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1413e8e9-da80-4e71-b631-31fd47e962bd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:24.006769 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1413e8e9-da80-4e71-b631-31fd47e962bd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:24.007528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1413e8e9-da80-4e71-b631-31fd47e962bd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:24.214713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-330763e7-bea7-403d-8085-4cb8f73e1161 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588884 Jan 17 02:35:24.215443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 75/150] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:35:23 2022] POST /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:35:24.239921 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b0ae6a47-0641-4ba9-8ba4-a2de266d802d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:24.241047 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b0ae6a47-0641-4ba9-8ba4-a2de266d802d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:24.265314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0ae6a47-0641-4ba9-8ba4-a2de266d802d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:24.265771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0ae6a47-0641-4ba9-8ba4-a2de266d802d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:24.266579 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0ae6a47-0641-4ba9-8ba4-a2de266d802d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:24.267016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0ae6a47-0641-4ba9-8ba4-a2de266d802d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:24.467729 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b0ae6a47-0641-4ba9-8ba4-a2de266d802d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.248600 Jan 17 02:35:24.468493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 76/151] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:24 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:24.476879 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-170556dd-ec99-4eef-ae20-3b88b5361f68 req-179791ba-13b2-4a24-b31a-a19d8fd92125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e3840c-9200-4dfe-8879-42d7cd878ec1", "tag": "c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:24.478481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:24.478481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:35:24.497956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-170556dd-ec99-4eef-ae20-3b88b5361f68 req-179791ba-13b2-4a24-b31a-a19d8fd92125 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:24.498756 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-170556dd-ec99-4eef-ae20-3b88b5361f68 req-179791ba-13b2-4a24-b31a-a19d8fd92125 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:24.529709 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-170556dd-ec99-4eef-ae20-3b88b5361f68 req-179791ba-13b2-4a24-b31a-a19d8fd92125 service nova] Creating event network-changed:c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a for instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 on hv-cinder-82160 Jan 17 02:35:24.552819 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-170556dd-ec99-4eef-ae20-3b88b5361f68 req-179791ba-13b2-4a24-b31a-a19d8fd92125 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079171 Jan 17 02:35:24.556463 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 77/152] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:24.598519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:24.601469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:24.623800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:24.624291 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:24.625089 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:24.633124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:24.654371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1413e8e9-da80-4e71-b631-31fd47e962bd tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "POST /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665914 Jan 17 02:35:24.656020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 76/153] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:35:23 2022] POST /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:35:24.861899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:24.871751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8597cbe8-29d2-48b8-88a3-7892764a6ff1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.313364 Jan 17 02:35:24.872652 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 78/154] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:24 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:25.480529 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-86c6cf6d-4612-42bf-8e9f-b0910f2909a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:25.481421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-86c6cf6d-4612-42bf-8e9f-b0910f2909a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:25.487680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-86c6cf6d-4612-42bf-8e9f-b0910f2909a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:25.488159 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-86c6cf6d-4612-42bf-8e9f-b0910f2909a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:25.488940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-86c6cf6d-4612-42bf-8e9f-b0910f2909a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:25.489538 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-86c6cf6d-4612-42bf-8e9f-b0910f2909a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:25.777827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-86c6cf6d-4612-42bf-8e9f-b0910f2909a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.295404 Jan 17 02:35:25.777827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 77/155] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:25 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:25.890479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:25.891619 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:25.900016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:25.900712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:25.901766 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:25.902405 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:26.014856 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2e2056b4-259d-4476-85a9-126c8a511ad9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:26.015882 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2e2056b4-259d-4476-85a9-126c8a511ad9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:26.026238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e2056b4-259d-4476-85a9-126c8a511ad9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:26.026955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e2056b4-259d-4476-85a9-126c8a511ad9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:26.028291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e2056b4-259d-4476-85a9-126c8a511ad9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:26.028926 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e2056b4-259d-4476-85a9-126c8a511ad9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:26.085078 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:26.093412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-65f6150c-57ed-4cf5-89cd-58c097b5d02e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.208479 Jan 17 02:35:26.096211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 79/156] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:25 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:26.117091 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-5875b2ed-79c2-4783-9caf-a9a5f22976ca req-1624b9fe-7b1f-4551-95c3-689bb258e7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d7c373-a92e-48a3-8605-f8655cf5cba4", "tag": "33b46f70-f49c-41cd-8f07-0740b1f82d6b"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:26.121004 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:26.121004 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:35:26.128507 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-5875b2ed-79c2-4783-9caf-a9a5f22976ca req-1624b9fe-7b1f-4551-95c3-689bb258e7a0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:26.129318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-5875b2ed-79c2-4783-9caf-a9a5f22976ca req-1624b9fe-7b1f-4551-95c3-689bb258e7a0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:26.141758 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-5875b2ed-79c2-4783-9caf-a9a5f22976ca req-1624b9fe-7b1f-4551-95c3-689bb258e7a0 service nova] Creating event network-changed:33b46f70-f49c-41cd-8f07-0740b1f82d6b for instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 on hv-cinder-82160 Jan 17 02:35:26.147517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-5875b2ed-79c2-4783-9caf-a9a5f22976ca req-1624b9fe-7b1f-4551-95c3-689bb258e7a0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049805 Jan 17 02:35:26.148831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 80/157] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:26.170455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2e2056b4-259d-4476-85a9-126c8a511ad9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.159317 Jan 17 02:35:26.172186 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 78/158] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:26 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 17 02:35:26.793103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-630add31-34af-443c-b55d-d857107c1e15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:26.796117 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-630add31-34af-443c-b55d-d857107c1e15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:26.811813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-630add31-34af-443c-b55d-d857107c1e15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:26.812306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-630add31-34af-443c-b55d-d857107c1e15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:26.813123 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-630add31-34af-443c-b55d-d857107c1e15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:26.813669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-630add31-34af-443c-b55d-d857107c1e15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:27.034099 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-630add31-34af-443c-b55d-d857107c1e15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.255521 Jan 17 02:35:27.038318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 81/159] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:26 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:27.116722 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:27.118766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:27.126829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:27.127280 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:27.128308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:27.128740 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:27.188548 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c72571e0-cca9-402c-a7de-11722e9ccf3e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:27.189573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c72571e0-cca9-402c-a7de-11722e9ccf3e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:27.206899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c72571e0-cca9-402c-a7de-11722e9ccf3e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:27.207414 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c72571e0-cca9-402c-a7de-11722e9ccf3e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:27.208177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c72571e0-cca9-402c-a7de-11722e9ccf3e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:27.216918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c72571e0-cca9-402c-a7de-11722e9ccf3e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:27.362284 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:27.367786 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c72571e0-cca9-402c-a7de-11722e9ccf3e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.183247 Jan 17 02:35:27.369234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 82/160] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:27 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:27.370878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a04befff-a3b2-4bf2-ae8c-a9b6525f8088 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.261210 Jan 17 02:35:27.371496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 79/161] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:27 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:28.046876 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f00ac76c-fc3a-4e51-b7a2-3b51de932373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:28.047889 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f00ac76c-fc3a-4e51-b7a2-3b51de932373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:28.054982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f00ac76c-fc3a-4e51-b7a2-3b51de932373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:28.055436 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f00ac76c-fc3a-4e51-b7a2-3b51de932373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:28.056253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f00ac76c-fc3a-4e51-b7a2-3b51de932373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:28.056719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f00ac76c-fc3a-4e51-b7a2-3b51de932373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:28.166514 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f00ac76c-fc3a-4e51-b7a2-3b51de932373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.123550 Jan 17 02:35:28.169687 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 83/162] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:28 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:28.379302 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-df179a72-7501-4012-a4d8-3b7266f01811 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:28.380408 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-df179a72-7501-4012-a4d8-3b7266f01811 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:28.387142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:28.387751 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df179a72-7501-4012-a4d8-3b7266f01811 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:28.387889 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:28.388574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df179a72-7501-4012-a4d8-3b7266f01811 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:28.389363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df179a72-7501-4012-a4d8-3b7266f01811 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:28.389835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df179a72-7501-4012-a4d8-3b7266f01811 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:28.395760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:28.396203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:28.396996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:28.397424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:28.545209 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:28.550398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-df179a72-7501-4012-a4d8-3b7266f01811 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.174613 Jan 17 02:35:28.551789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 80/163] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:28 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:28.556284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dc1deecd-0237-41d8-9d24-9f25a15725aa tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.173290 Jan 17 02:35:28.556955 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 84/164] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:28 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:29.179457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-abf5c8cb-0957-4569-97f8-7008814f463e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:29.180581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-abf5c8cb-0957-4569-97f8-7008814f463e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:29.187475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-abf5c8cb-0957-4569-97f8-7008814f463e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:29.188355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-abf5c8cb-0957-4569-97f8-7008814f463e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:29.189137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-abf5c8cb-0957-4569-97f8-7008814f463e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:29.189564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-abf5c8cb-0957-4569-97f8-7008814f463e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:29.304952 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-abf5c8cb-0957-4569-97f8-7008814f463e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.129885 Jan 17 02:35:29.305671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 81/165] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:29 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:29.561271 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3ceaeb42-230a-4b7d-933d-3ebffcc0675b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:29.562215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3ceaeb42-230a-4b7d-933d-3ebffcc0675b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:29.568738 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ceaeb42-230a-4b7d-933d-3ebffcc0675b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:29.569419 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ceaeb42-230a-4b7d-933d-3ebffcc0675b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:29.570480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ceaeb42-230a-4b7d-933d-3ebffcc0675b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:29.570950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ceaeb42-230a-4b7d-933d-3ebffcc0675b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:29.575773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:29.576309 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:29.583387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:29.583887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:29.584657 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:29.585269 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:29.700813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3ceaeb42-230a-4b7d-933d-3ebffcc0675b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.142966 Jan 17 02:35:29.702072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 85/166] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:29 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:29.755003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:29.763703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7b27f867-3e20-4f2e-9e51-0278d828199c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.193286 Jan 17 02:35:29.764661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 82/167] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:29 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:30.316936 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f890816c-ba33-42fa-9586-62b4a7413b05 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:30.317937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f890816c-ba33-42fa-9586-62b4a7413b05 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:30.325088 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f890816c-ba33-42fa-9586-62b4a7413b05 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:30.325538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f890816c-ba33-42fa-9586-62b4a7413b05 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:30.326315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f890816c-ba33-42fa-9586-62b4a7413b05 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:30.326743 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f890816c-ba33-42fa-9586-62b4a7413b05 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:30.458410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f890816c-ba33-42fa-9586-62b4a7413b05 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.145258 Jan 17 02:35:30.459002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 86/168] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:30 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:30.711650 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-948ff773-fbf1-42aa-bf67-796b7a41d0f3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:30.712511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-948ff773-fbf1-42aa-bf67-796b7a41d0f3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:30.719158 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-948ff773-fbf1-42aa-bf67-796b7a41d0f3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:30.719607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-948ff773-fbf1-42aa-bf67-796b7a41d0f3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:30.720413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-948ff773-fbf1-42aa-bf67-796b7a41d0f3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:30.720835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-948ff773-fbf1-42aa-bf67-796b7a41d0f3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:30.781967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:30.782657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:30.790090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:30.790542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:30.791332 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:30.791768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:30.911506 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-948ff773-fbf1-42aa-bf67-796b7a41d0f3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.203411 Jan 17 02:35:30.912169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 83/169] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:30 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:30.930080 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:30.937588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a315802a-fc67-43f5-b079-95947c147f4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.160138 Jan 17 02:35:30.938139 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 87/170] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:30 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:31.469470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-574d1a4c-842e-4bf3-ad48-ca305fcab8a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:31.470470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-574d1a4c-842e-4bf3-ad48-ca305fcab8a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:31.477700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-574d1a4c-842e-4bf3-ad48-ca305fcab8a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:31.478148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-574d1a4c-842e-4bf3-ad48-ca305fcab8a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:31.478958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-574d1a4c-842e-4bf3-ad48-ca305fcab8a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:31.479421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-574d1a4c-842e-4bf3-ad48-ca305fcab8a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:31.757306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-574d1a4c-842e-4bf3-ad48-ca305fcab8a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.291704 Jan 17 02:35:31.757977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 84/171] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:31 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:31.926562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3135f28b-17db-4b7e-9ad6-899e84f0fe59 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:31.928055 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3135f28b-17db-4b7e-9ad6-899e84f0fe59 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:31.936694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3135f28b-17db-4b7e-9ad6-899e84f0fe59 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:31.937137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3135f28b-17db-4b7e-9ad6-899e84f0fe59 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:31.937906 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3135f28b-17db-4b7e-9ad6-899e84f0fe59 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:31.938333 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3135f28b-17db-4b7e-9ad6-899e84f0fe59 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:31.954743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:31.955430 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:31.962516 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:31.962962 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:31.963741 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:31.964248 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:32.099527 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:32.107370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-83496b69-8b1b-4e83-9c35-324327e0f98e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.156747 Jan 17 02:35:32.107940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 85/172] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:31 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:32.125901 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3135f28b-17db-4b7e-9ad6-899e84f0fe59 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.205436 Jan 17 02:35:32.126523 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 88/173] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:31 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:32.338404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-11376627", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "51c5014e-4388-4f67-9eb7-eef46e8a6fe0"}]}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:32.391052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] validate_networks() for [('51c5014e-4388-4f67-9eb7-eef46e8a6fe0', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:35:32.730488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:35:32.731095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:35:32.731784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:35:32.732435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:35:32.733009 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:35:32.747382 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:32.747829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:32.748679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:32.749109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:32.765997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Getting quotas for project 20f3bbecadfb47dca935ac0986b088eb. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:35:32.768280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-48d0f439-14b3-413c-a30e-4f36cba51caa tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:32.769275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-48d0f439-14b3-413c-a30e-4f36cba51caa tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:32.770516 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Getting quotas for user 6ab457485fb6427ba5215ef491a03f9a and project 20f3bbecadfb47dca935ac0986b088eb. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:35:32.776417 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-48d0f439-14b3-413c-a30e-4f36cba51caa tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:32.777051 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-48d0f439-14b3-413c-a30e-4f36cba51caa tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:32.777829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-48d0f439-14b3-413c-a30e-4f36cba51caa tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:32.778284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-48d0f439-14b3-413c-a30e-4f36cba51caa tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:32.786775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:35:32.789141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:35:32.837775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7b33efe2-ee3a-4406-8bef-dfa5de05ef20 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503043 Jan 17 02:35:32.838587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 86/174] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:35:32.847787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f12649ea-f52c-4cf2-8381-585ed17afa37 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:32.848411 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f12649ea-f52c-4cf2-8381-585ed17afa37 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:32.897859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f12649ea-f52c-4cf2-8381-585ed17afa37 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:32.904512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f12649ea-f52c-4cf2-8381-585ed17afa37 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1212 microversion: 2.1 time: 0.060112 Jan 17 02:35:32.905090 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 87/175] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:32 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1212 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:32.935538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-48d0f439-14b3-413c-a30e-4f36cba51caa tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.171149 Jan 17 02:35:32.937884 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 89/176] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:32 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:33.124682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:33.125376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:33.132119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.132750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.133756 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.134331 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.137518 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9073301a-b308-4eb9-9f42-176519d0d83c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:33.138517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9073301a-b308-4eb9-9f42-176519d0d83c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:33.154395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9073301a-b308-4eb9-9f42-176519d0d83c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.154841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9073301a-b308-4eb9-9f42-176519d0d83c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.155624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9073301a-b308-4eb9-9f42-176519d0d83c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.156124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9073301a-b308-4eb9-9f42-176519d0d83c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.291164 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:33.298787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-65686dda-e3ba-47bb-a72c-5f0a66741c42 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.178161 Jan 17 02:35:33.299587 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9073301a-b308-4eb9-9f42-176519d0d83c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.166142 Jan 17 02:35:33.299959 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 88/177] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:33 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:33.301910 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 90/178] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:33 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:33.921229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:33.921827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:33.927829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.928305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.929072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.929496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.947667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c55773d1-67b6-450d-b32a-980019ecd656 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:33.948761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c55773d1-67b6-450d-b32a-980019ecd656 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:33.955776 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c55773d1-67b6-450d-b32a-980019ecd656 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.956253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c55773d1-67b6-450d-b32a-980019ecd656 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.957040 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c55773d1-67b6-450d-b32a-980019ecd656 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:33.957474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c55773d1-67b6-450d-b32a-980019ecd656 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:33.990643 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:33.998209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c2338462-9847-425a-8980-42dea1dcd86a tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1264 microversion: 2.1 time: 0.080795 Jan 17 02:35:33.998769 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 89/179] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:33 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1264 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:34.134359 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c55773d1-67b6-450d-b32a-980019ecd656 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.191046 Jan 17 02:35:34.135111 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 91/180] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:33 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:34.312778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-aec8cb52-9680-4810-b745-46d039662ecf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:34.313758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-aec8cb52-9680-4810-b745-46d039662ecf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:34.318014 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:34.318672 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:34.320831 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aec8cb52-9680-4810-b745-46d039662ecf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:34.321275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aec8cb52-9680-4810-b745-46d039662ecf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:34.322544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aec8cb52-9680-4810-b745-46d039662ecf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:34.322544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aec8cb52-9680-4810-b745-46d039662ecf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:34.325868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:34.326541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:34.327358 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:34.327975 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:34.463929 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:34.472239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f6019b20-e299-4982-835f-e29b02fb74cf tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.159714 Jan 17 02:35:34.473167 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 92/181] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:34 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:34.534868 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-aec8cb52-9680-4810-b745-46d039662ecf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.226103 Jan 17 02:35:34.536307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 90/182] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:34 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:35.014975 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:35.015749 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:35.023402 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.024050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.025144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.025753 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.090771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-108535996", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "97da4c82-5c36-47e9-8cea-2b4c9d79a703"}]}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:35.103719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:35.111825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c941bace-a6b5-411b-867d-0c5dfa07a2e2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1270 microversion: 2.1 time: 0.100623 Jan 17 02:35:35.112610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 93/183] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:35 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:35.145833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a4e47bf7-a0be-439a-9e5a-098dbfb158e2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:35.146763 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a4e47bf7-a0be-439a-9e5a-098dbfb158e2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:35.147206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] validate_networks() for [('97da4c82-5c36-47e9-8cea-2b4c9d79a703', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:35:35.153228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4e47bf7-a0be-439a-9e5a-098dbfb158e2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.153893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4e47bf7-a0be-439a-9e5a-098dbfb158e2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.154866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4e47bf7-a0be-439a-9e5a-098dbfb158e2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.155466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4e47bf7-a0be-439a-9e5a-098dbfb158e2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.258185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a4e47bf7-a0be-439a-9e5a-098dbfb158e2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.115726 Jan 17 02:35:35.261654 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 94/184] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:35 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:35.491149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:35.491870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:35.499210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.499876 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.500738 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.501174 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.527325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:35:35.527847 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:35:35.528458 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:35:35.529147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:35:35.529678 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:35:35.543173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.545149 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.546993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.549383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.569546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:35:35.574487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for user d19dac2ccdf34b62bf4dc5b43c034648 and project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:35:35.585923 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:35:35.588473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:35:35.639619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-76ccb1ce-4e68-4906-871f-6365c3a8b01a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552991 Jan 17 02:35:35.640546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 91/185] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 17 02:35:35.646295 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e58e1bcf-620c-4e95-b4bb-e5f7d0885a2d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:35.647553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e58e1bcf-620c-4e95-b4bb-e5f7d0885a2d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:35.654911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:35.658418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e58e1bcf-620c-4e95-b4bb-e5f7d0885a2d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.658953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e58e1bcf-620c-4e95-b4bb-e5f7d0885a2d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.660654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e58e1bcf-620c-4e95-b4bb-e5f7d0885a2d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:35.661103 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e58e1bcf-620c-4e95-b4bb-e5f7d0885a2d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:35.664792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d2d532d2-862b-4598-8ac2-de3c103ff13a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.178997 Jan 17 02:35:35.667052 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 95/186] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:35 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:35.672388 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ee25fd40-ea5b-45ad-82d8-007318329599 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:35.673547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ee25fd40-ea5b-45ad-82d8-007318329599 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:35.754847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ee25fd40-ea5b-45ad-82d8-007318329599 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:35.762768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ee25fd40-ea5b-45ad-82d8-007318329599 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1217 microversion: 2.1 time: 0.094079 Jan 17 02:35:35.763434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 96/187] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:35 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:35.830487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e58e1bcf-620c-4e95-b4bb-e5f7d0885a2d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.188371 Jan 17 02:35:35.831519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 92/188] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:35 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:36.129397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:36.130826 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:36.137856 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.138323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.139095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.139530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.269366 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f89c4cbd-91a2-4734-ab6a-524a00258e34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:36.271025 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f89c4cbd-91a2-4734-ab6a-524a00258e34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:36.277198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:36.288936 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-206c88af-e96d-45df-a5d4-c18d1f4ef8ca tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.163425 Jan 17 02:35:36.289847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 97/189] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:36 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:36.292018 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f89c4cbd-91a2-4734-ab6a-524a00258e34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.292658 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f89c4cbd-91a2-4734-ab6a-524a00258e34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.293598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f89c4cbd-91a2-4734-ab6a-524a00258e34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.294119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f89c4cbd-91a2-4734-ab6a-524a00258e34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.431626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f89c4cbd-91a2-4734-ab6a-524a00258e34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.166085 Jan 17 02:35:36.432393 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 93/190] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:36 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:36.565069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-22dc6f4e-1896-461c-9636-f3915ab6bc31 req-af386f8a-6d31-49f2-91f8-91a4a9408d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174c40e9-53cc-4bfc-a4e6-5969e5f48819", "tag": "2a1ba1ae-6423-44f8-bcf2-4aff4fbd50a7"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:36.566622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:36.566622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:35:36.574338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-22dc6f4e-1896-461c-9636-f3915ab6bc31 req-af386f8a-6d31-49f2-91f8-91a4a9408d0a service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.574845 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-22dc6f4e-1896-461c-9636-f3915ab6bc31 req-af386f8a-6d31-49f2-91f8-91a4a9408d0a service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.588307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-22dc6f4e-1896-461c-9636-f3915ab6bc31 req-af386f8a-6d31-49f2-91f8-91a4a9408d0a service nova] Creating event network-changed:2a1ba1ae-6423-44f8-bcf2-4aff4fbd50a7 for instance 174c40e9-53cc-4bfc-a4e6-5969e5f48819 on hv-cinder-82160 Jan 17 02:35:36.593319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-22dc6f4e-1896-461c-9636-f3915ab6bc31 req-af386f8a-6d31-49f2-91f8-91a4a9408d0a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031894 Jan 17 02:35:36.593913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 98/191] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:36.683478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:36.684325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:36.691458 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.691885 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.692685 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.693146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.780509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:36.781228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:36.788494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.789058 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.792816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.795526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.847892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:36.862267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-00615e6a-a945-4f6d-b92f-bf3b8592bcf9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.182775 Jan 17 02:35:36.863182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 94/192] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:36 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:36.875707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2b2327b9-5699-418f-a388-c58748b3b4c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:36.876960 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2b2327b9-5699-418f-a388-c58748b3b4c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:36.883747 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b2327b9-5699-418f-a388-c58748b3b4c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.884414 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b2327b9-5699-418f-a388-c58748b3b4c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.885400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b2327b9-5699-418f-a388-c58748b3b4c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:36.887467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b2327b9-5699-418f-a388-c58748b3b4c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:36.893001 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:36.901228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6d00db2e-873d-4158-9f7f-382324470928 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1269 microversion: 2.1 time: 0.124911 Jan 17 02:35:36.902447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 99/193] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:36 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:37.021436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2b2327b9-5699-418f-a388-c58748b3b4c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.157019 Jan 17 02:35:37.024584 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 95/194] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:36 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:37.306009 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:37.306848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:37.315599 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.316646 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:37.317567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.318132 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:37.445546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-24e00a0a-f959-4436-a31c-9a96b6284a0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:37.447209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-24e00a0a-f959-4436-a31c-9a96b6284a0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:37.455582 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e00a0a-f959-4436-a31c-9a96b6284a0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.456032 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e00a0a-f959-4436-a31c-9a96b6284a0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:37.457006 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e00a0a-f959-4436-a31c-9a96b6284a0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.457630 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e00a0a-f959-4436-a31c-9a96b6284a0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:37.516957 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:37.524878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5da13f7b-e469-4bfd-8685-78fb008eaca5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.222416 Jan 17 02:35:37.525453 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 100/195] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:37 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:37.752469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-24e00a0a-f959-4436-a31c-9a96b6284a0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.312744 Jan 17 02:35:37.753217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 96/196] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:37 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:37.879317 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:37.879830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:37.885694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.886119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:37.887138 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.887568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:37.919325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:37.920530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:37.928202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.928962 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:37.930004 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:37.930506 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.005914 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:38.013649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-415f1746-7bb3-4f49-a6a6-0dd53e0a45c2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1275 microversion: 2.1 time: 0.098424 Jan 17 02:35:38.014572 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 97/197] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:37 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:38.033162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-61b15306-ab18-437f-9436-7766529f45ef tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:38.034171 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-61b15306-ab18-437f-9436-7766529f45ef tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:38.040759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61b15306-ab18-437f-9436-7766529f45ef tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:38.041279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61b15306-ab18-437f-9436-7766529f45ef tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.042337 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61b15306-ab18-437f-9436-7766529f45ef tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:38.042772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61b15306-ab18-437f-9436-7766529f45ef tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.051209 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:38.058958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5aafef05-0b25-4090-817b-fd5fc66ba32d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.183401 Jan 17 02:35:38.059531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 101/198] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:37 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:38.324678 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-61b15306-ab18-437f-9436-7766529f45ef tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.295581 Jan 17 02:35:38.325338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 98/199] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:38 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:38.545243 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:38.545243 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:38.551254 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:38.551684 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.552504 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:38.552938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.725499 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-2733cd6f-7584-4e8f-bbc9-024bfb1175f7 req-25e2b94c-a405-436d-83af-390067543085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ccc6201-bf7b-4df8-bfc9-690b142202ee", "tag": "30e2dec1-14b3-4bc2-85e9-ce1f7d687cd2"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:38.728330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:38.728330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:35:38.745214 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-2733cd6f-7584-4e8f-bbc9-024bfb1175f7 req-25e2b94c-a405-436d-83af-390067543085 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:38.745677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-2733cd6f-7584-4e8f-bbc9-024bfb1175f7 req-25e2b94c-a405-436d-83af-390067543085 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.759315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-2733cd6f-7584-4e8f-bbc9-024bfb1175f7 req-25e2b94c-a405-436d-83af-390067543085 service nova] Creating event network-changed:30e2dec1-14b3-4bc2-85e9-ce1f7d687cd2 for instance 7ccc6201-bf7b-4df8-bfc9-690b142202ee on hv-cinder-82160 Jan 17 02:35:38.764287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-2733cd6f-7584-4e8f-bbc9-024bfb1175f7 req-25e2b94c-a405-436d-83af-390067543085 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043659 Jan 17 02:35:38.764886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 99/200] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:38.769848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-58303089-8d80-4ead-95db-53ea7c16344b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:38.770839 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-58303089-8d80-4ead-95db-53ea7c16344b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:38.785697 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58303089-8d80-4ead-95db-53ea7c16344b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:38.786146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58303089-8d80-4ead-95db-53ea7c16344b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.786949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:38.787072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58303089-8d80-4ead-95db-53ea7c16344b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:38.787383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58303089-8d80-4ead-95db-53ea7c16344b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:38.796538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6dc67378-6c28-4529-a773-e9d56881a0d6 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.257127 Jan 17 02:35:38.797637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 102/201] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:38 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:39.015235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-58303089-8d80-4ead-95db-53ea7c16344b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.248782 Jan 17 02:35:39.018576 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 100/202] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:38 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:39.030762 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:39.031367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:39.037959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.038406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.039181 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.040309 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.075682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:39.076405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:39.083490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.083939 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.084773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.085206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.332983 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:39.335623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:39.341465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fb86444b-0228-44cc-a0d8-ddd450372de9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.314343 Jan 17 02:35:39.350916 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4894ade8-a1ea-43d9-873f-2f62dcca0e08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.274335 Jan 17 02:35:39.350916 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 101/203] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:39 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:39.352539 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 103/204] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:39 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:39.352837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f72bc551-3ee1-4e89-b1b2-c3cad7607e7d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:39.353781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f72bc551-3ee1-4e89-b1b2-c3cad7607e7d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:39.360904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f72bc551-3ee1-4e89-b1b2-c3cad7607e7d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.361410 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f72bc551-3ee1-4e89-b1b2-c3cad7607e7d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.362262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f72bc551-3ee1-4e89-b1b2-c3cad7607e7d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.362757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f72bc551-3ee1-4e89-b1b2-c3cad7607e7d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.556204 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f72bc551-3ee1-4e89-b1b2-c3cad7607e7d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.206727 Jan 17 02:35:39.559534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 102/205] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:39 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:39.814577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:39.815141 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:39.822435 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.822904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.823702 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:39.824196 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:39.964872 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:39.972290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2d6a1684-c676-426b-a411-2009d3841eb7 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.161615 Jan 17 02:35:39.972868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 104/206] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:39 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:40.026328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-aaae9e86-4cf4-4a65-accc-d69be5b50a4e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:40.027378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-aaae9e86-4cf4-4a65-accc-d69be5b50a4e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:40.034173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaae9e86-4cf4-4a65-accc-d69be5b50a4e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.034623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaae9e86-4cf4-4a65-accc-d69be5b50a4e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.035749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaae9e86-4cf4-4a65-accc-d69be5b50a4e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.036216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaae9e86-4cf4-4a65-accc-d69be5b50a4e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.263841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-aaae9e86-4cf4-4a65-accc-d69be5b50a4e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 14 microversion: 2.20 time: 0.241374 Jan 17 02:35:40.266259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 103/207] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:40 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:40.358247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:40.359535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:40.366500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:40.367432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:40.367713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.368188 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.369859 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.371333 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.376946 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.377402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.378203 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.378752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.836697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:40.840830 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:40.844461 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-68c503e4-caf4-44d8-98b8-84521cc81da9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.489696 Jan 17 02:35:40.845150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 105/208] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:40 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:40.850433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1fc58229-6976-45e5-a8d0-db2a10c0be6e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:40.851408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1fc58229-6976-45e5-a8d0-db2a10c0be6e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:40.854433 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2d3bece9-3eb4-4a38-a5bf-f4ff92641aae tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.493504 Jan 17 02:35:40.856032 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 104/209] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:40 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:40.858197 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1fc58229-6976-45e5-a8d0-db2a10c0be6e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.858643 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1fc58229-6976-45e5-a8d0-db2a10c0be6e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.859408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1fc58229-6976-45e5-a8d0-db2a10c0be6e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.859869 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1fc58229-6976-45e5-a8d0-db2a10c0be6e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.988977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:40.990037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:40.997265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.997876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:40.999152 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:40.999673 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:41.058423 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1fc58229-6976-45e5-a8d0-db2a10c0be6e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 14 microversion: 2.1 time: 0.211856 Jan 17 02:35:41.059397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 106/210] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:40 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:35:41.134547 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:41.141824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e857f10e-a360-4a46-9450-9c0ace1b6de5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.157228 Jan 17 02:35:41.142389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 105/211] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:40 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:41.276437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5aeca187-7ab0-4b6c-9adb-875f3f028fec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:41.277539 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5aeca187-7ab0-4b6c-9adb-875f3f028fec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:41.286635 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aeca187-7ab0-4b6c-9adb-875f3f028fec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:41.287441 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aeca187-7ab0-4b6c-9adb-875f3f028fec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:41.288564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aeca187-7ab0-4b6c-9adb-875f3f028fec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:41.289086 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5aeca187-7ab0-4b6c-9adb-875f3f028fec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:41.491270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5aeca187-7ab0-4b6c-9adb-875f3f028fec tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 5948 microversion: 2.20 time: 0.219238 Jan 17 02:35:41.492350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 107/212] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:41 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 5948 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:35:41.862099 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:41.862697 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:41.869257 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:41.869720 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:41.870478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:41.871288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:41.872924 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:41.873666 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:41.883310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:41.883810 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:41.884678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:41.885114 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:42.072549 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:42.075660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:42.081712 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0b99e080-95c5-4bac-bf67-f76e38d98e55 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.223250 Jan 17 02:35:42.082578 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 106/213] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:41 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:42.083465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2c8bbada-45e6-45cf-a8fd-d2c9d6ce9ddd tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.215194 Jan 17 02:35:42.084082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 108/214] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:41 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:42.087401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c7faaa26-96b4-4334-ab0b-caaf312ecdd2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:42.088467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c7faaa26-96b4-4334-ab0b-caaf312ecdd2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:42.095473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7faaa26-96b4-4334-ab0b-caaf312ecdd2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:42.096006 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7faaa26-96b4-4334-ab0b-caaf312ecdd2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:42.096889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7faaa26-96b4-4334-ab0b-caaf312ecdd2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:42.097395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7faaa26-96b4-4334-ab0b-caaf312ecdd2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:42.158608 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:42.159280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:42.166180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:42.166617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:42.167385 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:42.167810 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:42.301219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:42.311397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-39b77aeb-5627-4235-b044-012989bea883 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.156443 Jan 17 02:35:42.312144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 109/215] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:42 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:42.502269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2a344313-4eac-42d7-99a6-0c7237b8e478 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:42.503246 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2a344313-4eac-42d7-99a6-0c7237b8e478 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:42.509902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a344313-4eac-42d7-99a6-0c7237b8e478 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:42.510324 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a344313-4eac-42d7-99a6-0c7237b8e478 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:42.511137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a344313-4eac-42d7-99a6-0c7237b8e478 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:42.511573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a344313-4eac-42d7-99a6-0c7237b8e478 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:46.837986 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c7faaa26-96b4-4334-ab0b-caaf312ecdd2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 12411 microversion: 2.1 time: 4.753354 Jan 17 02:35:46.838863 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 107/216] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:42 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 12411 bytes in 4756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:35:46.846444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:46.847564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:46.857709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:46.859550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:46.859550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:46.859550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:46.985087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2a344313-4eac-42d7-99a6-0c7237b8e478 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 17861 microversion: 2.20 time: 4.486442 Jan 17 02:35:46.989473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 110/217] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:42 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 17861 bytes in 4489 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:35:46.993048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:46.993817 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:47.001553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:47.002005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:47.002768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:47.002933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:47.003215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:47.010209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-293ba25a-29f6-4093-87b4-6aeb2155f09e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.169926 Jan 17 02:35:47.010832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 108/218] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:46 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:47.015009 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:47.015603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:47.021257 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:47.021704 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:47.022477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:47.022906 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:47.189009 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:47.196817 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0186b37a-ce43-44ff-aaaa-1a44032b2533 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.208569 Jan 17 02:35:47.203788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 111/219] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:46 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:47.203936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:47.207832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3dff04b3-5f9a-4fa5-ad23-c451dcc97f6b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.196082 Jan 17 02:35:47.208513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 109/220] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:47 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:47.855069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9ed83486-88e9-4050-8b57-3a9a52539839 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:47.856445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9ed83486-88e9-4050-8b57-3a9a52539839 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:47.866943 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ed83486-88e9-4050-8b57-3a9a52539839 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:47.867683 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ed83486-88e9-4050-8b57-3a9a52539839 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:47.869006 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ed83486-88e9-4050-8b57-3a9a52539839 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:47.869717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ed83486-88e9-4050-8b57-3a9a52539839 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:47.997107 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-af32b980-ddc5-4dca-b143-9ad04f0f4503 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:47.998031 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-af32b980-ddc5-4dca-b143-9ad04f0f4503 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:48.004488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-af32b980-ddc5-4dca-b143-9ad04f0f4503 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.004934 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-af32b980-ddc5-4dca-b143-9ad04f0f4503 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.005709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-af32b980-ddc5-4dca-b143-9ad04f0f4503 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.006130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-af32b980-ddc5-4dca-b143-9ad04f0f4503 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.293391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9ed83486-88e9-4050-8b57-3a9a52539839 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 17960 microversion: 2.1 time: 0.444512 Jan 17 02:35:48.294265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 112/221] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:47 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 17960 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:35:48.299090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:48.299848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:48.306899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.307348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.308152 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.308589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.348534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-af32b980-ddc5-4dca-b143-9ad04f0f4503 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 18663 microversion: 2.20 time: 0.355005 Jan 17 02:35:48.349213 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 110/222] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:47 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 18663 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:35:48.354123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:48.354801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:48.361942 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.362394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.363204 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.363632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.478404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:48.486302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5a95ca82-cc93-4afb-b2fd-ed40485b6ffc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.190918 Jan 17 02:35:48.487073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 113/223] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:48 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:48.497232 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:48.497800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:48.504229 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.504644 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.505443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:48.505841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:48.521761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:48.529611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b1c8bf92-24b9-4133-a09f-026e2c944bb4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.179298 Jan 17 02:35:48.530496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 111/224] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:48 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:48.661341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:48.668905 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ead8e31f-294a-47e4-b40b-4f7e6b560035 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.176269 Jan 17 02:35:48.669481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 114/225] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:48 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:49.101342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:49.101952 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:49.109777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.110225 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.111010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.111444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.136835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:35:49.233917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9b7e0be5-db6c-4889-b3f8-e3bf85c11522 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 204 len: 0 microversion: 2.1 time: 0.137670 Jan 17 02:35:49.234389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 112/226] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:35:49 2022] DELETE /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:35:49.243545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:49.243545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:49.250059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.250601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.251378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.251808 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.304904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2250fdba-6454-42b4-a810-b33b6fc4a48f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:49.305987 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2250fdba-6454-42b4-a810-b33b6fc4a48f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:49.312961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2250fdba-6454-42b4-a810-b33b6fc4a48f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.313413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2250fdba-6454-42b4-a810-b33b6fc4a48f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.314193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2250fdba-6454-42b4-a810-b33b6fc4a48f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.314631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2250fdba-6454-42b4-a810-b33b6fc4a48f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.386125 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:49.394556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-86f113fc-c90d-4150-b483-71d1485a9396 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.156075 Jan 17 02:35:49.395156 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 115/227] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:49 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:49.408924 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fed74e33-dda5-4c7b-84e0-6348723f2a00 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:49.410477 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fed74e33-dda5-4c7b-84e0-6348723f2a00 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:49.416436 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fed74e33-dda5-4c7b-84e0-6348723f2a00 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.416893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fed74e33-dda5-4c7b-84e0-6348723f2a00 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.417708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fed74e33-dda5-4c7b-84e0-6348723f2a00 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.418141 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fed74e33-dda5-4c7b-84e0-6348723f2a00 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.443955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2250fdba-6454-42b4-a810-b33b6fc4a48f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 18208 microversion: 2.1 time: 0.142855 Jan 17 02:35:49.444633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 113/228] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:49 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 18208 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:35:49.504050 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:49.504773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:49.511935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.512444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.513287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.513739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.564050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fed74e33-dda5-4c7b-84e0-6348723f2a00 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 19446 microversion: 2.20 time: 0.158468 Jan 17 02:35:49.566231 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 116/229] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:49 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 19446 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:35:49.569971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-530114eb-5c90-4cf5-b771-47d2124dff61 req-02889088-44cb-4a9c-9bd6-d6c255eb9321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174c40e9-53cc-4bfc-a4e6-5969e5f48819", "name": "network-vif-plugged", "status": "completed", "tag": "2a1ba1ae-6423-44f8-bcf2-4aff4fbd50a7"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:49.571725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:49.571725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:35:49.579911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-530114eb-5c90-4cf5-b771-47d2124dff61 req-02889088-44cb-4a9c-9bd6-d6c255eb9321 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.580382 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-530114eb-5c90-4cf5-b771-47d2124dff61 req-02889088-44cb-4a9c-9bd6-d6c255eb9321 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.591865 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-530114eb-5c90-4cf5-b771-47d2124dff61 req-02889088-44cb-4a9c-9bd6-d6c255eb9321 service nova] Creating event network-vif-plugged:2a1ba1ae-6423-44f8-bcf2-4aff4fbd50a7 for instance 174c40e9-53cc-4bfc-a4e6-5969e5f48819 on hv-cinder-82160 Jan 17 02:35:49.596707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-530114eb-5c90-4cf5-b771-47d2124dff61 req-02889088-44cb-4a9c-9bd6-d6c255eb9321 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030432 Jan 17 02:35:49.597358 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 117/230] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:49.602146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:49.602834 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:49.609007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.609457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.610239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.610673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.644310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:49.654255 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-68118858-7db2-4fdd-b629-a7ce6623cdf3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.154371 Jan 17 02:35:49.661944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 114/231] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:49 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:49.686789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:49.687549 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:49.694508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.694949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.695831 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:49.696451 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:49.776538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:49.784036 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f9e59f0d-94b1-4ee9-bf90-85ff3a676a57 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.185504 Jan 17 02:35:49.793691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 118/232] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:49 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:49.846488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:49.854150 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-67cd86f5-7356-4039-965a-329a033f2c1f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.171659 Jan 17 02:35:49.854928 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 115/233] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:49 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:35:50.416456 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:50.417306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:50.427220 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.427782 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.428989 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.429646 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.456537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fbe69419-304a-41cd-865f-9082d042c893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:50.457554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fbe69419-304a-41cd-865f-9082d042c893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:50.464006 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fbe69419-304a-41cd-865f-9082d042c893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.464464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fbe69419-304a-41cd-865f-9082d042c893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.465222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fbe69419-304a-41cd-865f-9082d042c893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.465682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fbe69419-304a-41cd-865f-9082d042c893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.577389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:50.585218 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2c4257c5-d32b-4724-a000-743584c3fc03 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.176013 Jan 17 02:35:50.585782 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 119/234] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:50 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:50.590147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1299b2fd-172f-41a0-a353-d309d1dbc5df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:50.591094 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1299b2fd-172f-41a0-a353-d309d1dbc5df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:50.596742 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1299b2fd-172f-41a0-a353-d309d1dbc5df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.597185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1299b2fd-172f-41a0-a353-d309d1dbc5df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.597951 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1299b2fd-172f-41a0-a353-d309d1dbc5df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.598379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1299b2fd-172f-41a0-a353-d309d1dbc5df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.837310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1299b2fd-172f-41a0-a353-d309d1dbc5df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 21784 microversion: 2.20 time: 0.249622 Jan 17 02:35:50.838253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 120/235] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:50 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 21784 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:35:50.843844 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:50.844553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:50.851681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.852173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.852977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.853409 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.912710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fbe69419-304a-41cd-865f-9082d042c893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 19774 microversion: 2.1 time: 0.459633 Jan 17 02:35:50.914118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 116/236] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:50 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 19774 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:35:50.919265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:50.920110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:50.928395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.928838 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:50.929621 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:50.930029 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.010157 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:51.017754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e901e2ae-e311-4656-ad27-917d4e229ba7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.177986 Jan 17 02:35:51.018321 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 121/237] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:50 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:51.022558 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:51.023143 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:51.029238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.029686 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.030452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.030877 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.084007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:51.092108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8f1eec25-aa07-4d08-b29c-ec07a245ebe5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.177193 Jan 17 02:35:51.092715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 117/238] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:50 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:51.172896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:51.180584 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2e17f391-11de-4600-99e5-1f3e45c9c0fd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.161330 Jan 17 02:35:51.181143 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 122/239] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:51 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:51.601828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:51.602342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:51.609553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.610005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.610776 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.611208 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.614170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-e1ff0eae-0267-4a31-abc5-15bf3f85745a req-9c2ed810-3c86-46b4-a41d-a7af3f44e559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccc6201-bf7b-4df8-bfc9-690b142202ee", "name": "network-vif-plugged", "status": "completed", "tag": "30e2dec1-14b3-4bc2-85e9-ce1f7d687cd2"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:51.615842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:35:51.615842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:35:51.623100 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e1ff0eae-0267-4a31-abc5-15bf3f85745a req-9c2ed810-3c86-46b4-a41d-a7af3f44e559 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.623603 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e1ff0eae-0267-4a31-abc5-15bf3f85745a req-9c2ed810-3c86-46b4-a41d-a7af3f44e559 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.635816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-e1ff0eae-0267-4a31-abc5-15bf3f85745a req-9c2ed810-3c86-46b4-a41d-a7af3f44e559 service nova] Creating event network-vif-plugged:30e2dec1-14b3-4bc2-85e9-ce1f7d687cd2 for instance 7ccc6201-bf7b-4df8-bfc9-690b142202ee on hv-cinder-82160 Jan 17 02:35:51.640826 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-e1ff0eae-0267-4a31-abc5-15bf3f85745a req-9c2ed810-3c86-46b4-a41d-a7af3f44e559 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Jan 17 02:35:51.641484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 123/240] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:35:51.745134 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:51.754638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5a2ce3e1-94b7-4e4c-8045-0ad973ad0a66 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.155263 Jan 17 02:35:51.754638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 118/241] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:51 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:51.851239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d4829d9d-c00e-4abe-b3ec-3190d3154451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:51.852371 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d4829d9d-c00e-4abe-b3ec-3190d3154451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:51.859203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4829d9d-c00e-4abe-b3ec-3190d3154451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.859701 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4829d9d-c00e-4abe-b3ec-3190d3154451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.860546 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4829d9d-c00e-4abe-b3ec-3190d3154451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.861070 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4829d9d-c00e-4abe-b3ec-3190d3154451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.925749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-47d1d31d-b3b3-4022-9245-1c3666550f71 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:51.926724 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-47d1d31d-b3b3-4022-9245-1c3666550f71 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:51.937698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47d1d31d-b3b3-4022-9245-1c3666550f71 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.938187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47d1d31d-b3b3-4022-9245-1c3666550f71 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:51.938970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47d1d31d-b3b3-4022-9245-1c3666550f71 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:51.939371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47d1d31d-b3b3-4022-9245-1c3666550f71 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.154056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-47d1d31d-b3b3-4022-9245-1c3666550f71 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 21332 microversion: 2.1 time: 0.231895 Jan 17 02:35:52.154694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 119/242] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:51 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 21332 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:35:52.159510 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:52.160548 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:52.167448 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.167893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.168702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.169131 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.307212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:52.314642 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-297532e6-d07c-4c85-ae84-b9f459533103 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.158837 Jan 17 02:35:52.315210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 120/243] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:52 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:52.319526 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:52.320124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:52.325783 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.326234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.327005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.327438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.458019 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:52.465574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1343272b-1a05-4d15-996e-ff43aa28ce79 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.149449 Jan 17 02:35:52.466143 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 121/244] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:52 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:52.470253 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:52.470833 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:52.476632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.477177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.477922 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.478349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.607904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:52.615609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-45b64143-9492-46da-83eb-7a32458d6d10 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.148550 Jan 17 02:35:52.616220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 122/245] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:52 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:52.771126 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:52.771636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:52.778635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.779085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.779851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:52.780311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:52.915756 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:52.928305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c3c1c5cd-3856-441d-8da9-9ceaa42ab4a3 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.160524 Jan 17 02:35:52.929309 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 123/246] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:52 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:53.169504 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-869e3cdd-9b3c-4bab-87bd-792182bf2150 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:53.171104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-869e3cdd-9b3c-4bab-87bd-792182bf2150 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:53.181385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-869e3cdd-9b3c-4bab-87bd-792182bf2150 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:53.182132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-869e3cdd-9b3c-4bab-87bd-792182bf2150 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:53.183424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-869e3cdd-9b3c-4bab-87bd-792182bf2150 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:53.184211 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-869e3cdd-9b3c-4bab-87bd-792182bf2150 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:58.825420 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d4829d9d-c00e-4abe-b3ec-3190d3154451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 26526 microversion: 2.20 time: 6.978109 Jan 17 02:35:58.826941 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 124/247] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:51 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 26526 bytes in 6981 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:35:58.832103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:58.832881 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:58.841554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:58.842046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:58.842895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:58.843373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:58.988994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:58.996650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1e4257db-455f-4d5f-8860-63ea838fc6ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.168530 Jan 17 02:35:58.997176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 125/248] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:58 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:59.001455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:59.002060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:59.007698 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.008189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:59.008969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.009408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:59.080718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-869e3cdd-9b3c-4bab-87bd-792182bf2150 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 25828 microversion: 2.1 time: 5.917180 Jan 17 02:35:59.081621 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 124/249] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:35:53 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 25828 bytes in 5919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:35:59.086363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:59.087042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:59.094175 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.094653 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:59.095433 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.095836 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:59.168093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:59.175412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f04464dd-6ca1-4394-b31c-bf9efdc0e7bc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.177255 Jan 17 02:35:59.175988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 126/250] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:58 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:59.180274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:35:59.180872 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:59.186905 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.187355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:59.188164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.188628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:59.244865 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:59.252465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ce6ec743-3720-4d86-bf58-ca64cd3fd3f0 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1312 microversion: 2.1 time: 0.169688 Jan 17 02:35:59.253282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 125/251] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:59 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:59.332801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:35:59.341227 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3ec3cdb4-f4bc-4b62-9324-7077f38a99d8 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.164260 Jan 17 02:35:59.341798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 127/252] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:35:59 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:35:59.837803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-354efe60-89da-4875-a5b9-e35d9dd21824 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:35:59.838861 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-354efe60-89da-4875-a5b9-e35d9dd21824 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:35:59.845533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-354efe60-89da-4875-a5b9-e35d9dd21824 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.845982 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-354efe60-89da-4875-a5b9-e35d9dd21824 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:35:59.846757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-354efe60-89da-4875-a5b9-e35d9dd21824 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:35:59.847197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-354efe60-89da-4875-a5b9-e35d9dd21824 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.013451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:00.014061 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:00.020798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.021243 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.022034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.022471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.152589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:00.160672 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4d4d8992-0fa8-494a-a624-c70f38d65256 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.150778 Jan 17 02:36:00.161243 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 128/253] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:00 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:00.166936 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7cee5207-73c1-4b43-bfd1-eecb1b3bebff tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:00.168085 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7cee5207-73c1-4b43-bfd1-eecb1b3bebff tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:00.174278 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7cee5207-73c1-4b43-bfd1-eecb1b3bebff tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.174721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7cee5207-73c1-4b43-bfd1-eecb1b3bebff tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.175496 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7cee5207-73c1-4b43-bfd1-eecb1b3bebff tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.175922 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7cee5207-73c1-4b43-bfd1-eecb1b3bebff tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.176455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-354efe60-89da-4875-a5b9-e35d9dd21824 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 26901 microversion: 2.20 time: 0.342252 Jan 17 02:36:00.177104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 126/254] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:35:59 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 26901 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:00.192291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:00.193261 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:00.200507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.201154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.201939 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.202546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.357356 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:00.367925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4d7c2139-2924-4e76-b4ee-abfb890729b0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.179549 Jan 17 02:36:00.368623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 127/255] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:00 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:00.373062 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:00.374604 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:00.381125 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.381640 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.382556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.383050 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.397677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7cee5207-73c1-4b43-bfd1-eecb1b3bebff tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 26249 microversion: 2.1 time: 0.235099 Jan 17 02:36:00.398661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 129/256] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:00 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 26249 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:00.404885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:00.405839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:00.413862 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.414526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.415585 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:00.416228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:00.593087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:00.602314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-10891990-6cf1-432d-b73d-918ac7d01247 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1497 microversion: 2.1 time: 0.232634 Jan 17 02:36:00.603126 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 128/257] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:00 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:00.617652 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:00.626262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-483e020d-2cc0-46e2-9212-bde73d4d1ca2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.226171 Jan 17 02:36:00.626838 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 130/258] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:00 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:01.177166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:01.177777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:01.184149 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.184596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.185370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.185801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.188436 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dc7c7ac3-ae7f-4d9e-9fbd-7ab28f399328 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:01.189359 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dc7c7ac3-ae7f-4d9e-9fbd-7ab28f399328 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:01.195958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc7c7ac3-ae7f-4d9e-9fbd-7ab28f399328 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.196431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc7c7ac3-ae7f-4d9e-9fbd-7ab28f399328 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.197198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc7c7ac3-ae7f-4d9e-9fbd-7ab28f399328 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.197626 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc7c7ac3-ae7f-4d9e-9fbd-7ab28f399328 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.325695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:01.333400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ad02845e-cf0d-42a1-92f1-3a2f10822017 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1317 microversion: 2.1 time: 0.160004 Jan 17 02:36:01.334452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 129/259] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:01 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:01.384853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:01.385575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:01.391709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.392191 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.392958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.393455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.467018 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dc7c7ac3-ae7f-4d9e-9fbd-7ab28f399328 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 27242 microversion: 2.20 time: 0.282169 Jan 17 02:36:01.471326 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 131/260] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:01 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 27242 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:01.476215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-91d25caa-19a1-493d-b9bf-8f26d7ea6baa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:01.477301 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-91d25caa-19a1-493d-b9bf-8f26d7ea6baa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:01.484779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91d25caa-19a1-493d-b9bf-8f26d7ea6baa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.485230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91d25caa-19a1-493d-b9bf-8f26d7ea6baa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.486035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91d25caa-19a1-493d-b9bf-8f26d7ea6baa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.486715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91d25caa-19a1-493d-b9bf-8f26d7ea6baa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.527795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:01.537038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-573ea622-1059-467a-9014-d7b9e48bb882 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.155906 Jan 17 02:36:01.537715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 130/261] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:01 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:01.643533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:01.644183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:01.650220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.650675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.651508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:01.651940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:01.778510 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:01.786980 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a90ab1b3-bf1f-4b89-9dc1-6992f7dd08b7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.147317 Jan 17 02:36:01.787564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 131/262] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:01 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:01.796439 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-91d25caa-19a1-493d-b9bf-8f26d7ea6baa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 26760 microversion: 2.1 time: 0.326874 Jan 17 02:36:01.797069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 132/263] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:01 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 26760 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:02.352670 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:02.353413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:02.361677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.362279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.363327 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.363883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.463260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:02.463829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:02.470692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.471134 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.471937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.472404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.497574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:36:02.501917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:02.509368 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fcbfc83a-ad32-442e-82ea-54dbbf3915ac tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1506 microversion: 2.1 time: 0.161654 Jan 17 02:36:02.509936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 132/264] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:02 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:02.514436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fd8c149d-5cb7-4844-965f-ef1693a02332 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:02.515419 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fd8c149d-5cb7-4844-965f-ef1693a02332 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:02.521266 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd8c149d-5cb7-4844-965f-ef1693a02332 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.521714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd8c149d-5cb7-4844-965f-ef1693a02332 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.522493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd8c149d-5cb7-4844-965f-ef1693a02332 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.522917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fd8c149d-5cb7-4844-965f-ef1693a02332 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.583829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-014103a1-2eff-489c-ac7d-2d923b0fafb5 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 204 len: 0 microversion: 2.1 time: 0.124328 Jan 17 02:36:02.584447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 133/265] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:36:02 2022] DELETE /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 17 02:36:02.589615 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "669b664a-3474-43bd-b32c-c908cb5ca1ba"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:02.590746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:02.596526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.596976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.597755 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.598185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.687773 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] HTTP exception thrown: Invalid volume: volume 669b664a-3474-43bd-b32c-c908cb5ca1ba is already attached to instances: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 Jan 17 02:36:02.688367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Returning 400 to user: Invalid volume: volume 669b664a-3474-43bd-b32c-c908cb5ca1ba is already attached to instances: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:02.689356 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-70f01229-e5b3-4f91-b3ea-24e7cf7d4b0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103603 Jan 17 02:36:02.689998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 134/266] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:36:02 2022] POST /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:36:02.698906 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:02.699749 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:02.708421 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.709150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.710472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.711859 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.839130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fd8c149d-5cb7-4844-965f-ef1693a02332 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 27563 microversion: 2.20 time: 0.327636 Jan 17 02:36:02.840630 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 133/267] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:02 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 27563 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:02.846080 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:02.847052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:02.855002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.855626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.857439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.858473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.893408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:02.901213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1abc8945-d87a-4ee9-8f26-33238c90e566 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.206053 Jan 17 02:36:02.902116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 135/268] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:02 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:02.907106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:02.907801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:02.914627 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.915301 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:02.916278 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:02.916862 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.050511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:03.059970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-80c7d2f0-9b7f-46fb-a359-c0da6693b04c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1503 microversion: 2.1 time: 0.217802 Jan 17 02:36:03.060933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 134/269] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:02 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:03.065753 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:03.066833 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:03.083244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.083699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.084517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.085097 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.105335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lazy-loading 'services' on Instance uuid 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:36:03.265982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1d5c1f19-130a-41d5-b986-ed12ac1a8d6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments/669b664a-3474-43bd-b32c-c908cb5ca1ba" status: 202 len: 0 microversion: 2.1 time: 0.361589 Jan 17 02:36:03.266502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 136/270] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:36:02 2022] DELETE /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments/669b664a-3474-43bd-b32c-c908cb5ca1ba => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:03.277161 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-478aa3f2-864c-4015-982d-a7fe1e191ba8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:03.278220 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-478aa3f2-864c-4015-982d-a7fe1e191ba8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:03.294144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-478aa3f2-864c-4015-982d-a7fe1e191ba8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.294778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-478aa3f2-864c-4015-982d-a7fe1e191ba8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.296220 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-478aa3f2-864c-4015-982d-a7fe1e191ba8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.296753 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-478aa3f2-864c-4015-982d-a7fe1e191ba8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.321965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:03.335463 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ce9a1684-54f6-4945-bbf1-db38e3bf4f07 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1552 microversion: 2.1 time: 0.273266 Jan 17 02:36:03.336625 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 135/271] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:03 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1552 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:03.351342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-83c16475-9551-434f-8b38-7493e09782c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:03.353210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-83c16475-9551-434f-8b38-7493e09782c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:03.360439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83c16475-9551-434f-8b38-7493e09782c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.362760 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83c16475-9551-434f-8b38-7493e09782c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.365671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83c16475-9551-434f-8b38-7493e09782c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.366411 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-83c16475-9551-434f-8b38-7493e09782c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.400618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-83c16475-9551-434f-8b38-7493e09782c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062790 Jan 17 02:36:03.401222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 136/272] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:03 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:03.505083 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-478aa3f2-864c-4015-982d-a7fe1e191ba8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 27339 microversion: 2.1 time: 0.233292 Jan 17 02:36:03.505809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 137/273] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:03 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 27339 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:03.514420 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-94e8c0a4-21cb-43bb-80d0-68dbaa201a3b req-29428576-9a4d-447b-9f7f-10de87cd1d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e2a65-a1ed-433d-92ef-fc11b3a1b233", "name": "network-vif-deleted", "tag": "8442125d-91ba-4cc7-a1a2-404f0c258981"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:03.515932 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:03.515932 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:36:03.523312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-94e8c0a4-21cb-43bb-80d0-68dbaa201a3b req-29428576-9a4d-447b-9f7f-10de87cd1d81 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.523754 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-94e8c0a4-21cb-43bb-80d0-68dbaa201a3b req-29428576-9a4d-447b-9f7f-10de87cd1d81 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.534802 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-94e8c0a4-21cb-43bb-80d0-68dbaa201a3b req-29428576-9a4d-447b-9f7f-10de87cd1d81 service nova] Creating event network-vif-deleted:8442125d-91ba-4cc7-a1a2-404f0c258981 for instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 on hv-cinder-82160 Jan 17 02:36:03.539613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-94e8c0a4-21cb-43bb-80d0-68dbaa201a3b req-29428576-9a4d-447b-9f7f-10de87cd1d81 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028896 Jan 17 02:36:03.540325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 137/274] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:03.851708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b0f88464-e1b9-4fe4-a330-7fd2910639b4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:03.852873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b0f88464-e1b9-4fe4-a330-7fd2910639b4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:03.859779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0f88464-e1b9-4fe4-a330-7fd2910639b4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.860276 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0f88464-e1b9-4fe4-a330-7fd2910639b4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.861112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0f88464-e1b9-4fe4-a330-7fd2910639b4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.861619 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b0f88464-e1b9-4fe4-a330-7fd2910639b4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.919412 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:03.920112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:03.927376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.927884 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:03.928644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:03.929083 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.058105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:04.065586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b0f88464-e1b9-4fe4-a330-7fd2910639b4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 27678 microversion: 2.20 time: 0.217882 Jan 17 02:36:04.065894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-33700293-b19e-40f9-8d53-aa6a54e1a887 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.150537 Jan 17 02:36:04.075435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 138/275] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:03 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:04.075517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 138/276] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:03 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 27678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:04.077221 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:04.077855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:04.087151 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.087595 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.088404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.088840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.219459 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:04.226723 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-29dd1450-5b78-4be2-b391-5344c2e70662 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1503 microversion: 2.1 time: 0.153088 Jan 17 02:36:04.227291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 139/277] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:04 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:04.352781 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:04.353465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:04.360692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.361145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.361962 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.362410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.412544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fcbcaf33-1b14-4af1-8e4c-9fb8fb0c88dc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:04.413480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fcbcaf33-1b14-4af1-8e4c-9fb8fb0c88dc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:04.419474 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbcaf33-1b14-4af1-8e4c-9fb8fb0c88dc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.419894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbcaf33-1b14-4af1-8e4c-9fb8fb0c88dc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.420695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbcaf33-1b14-4af1-8e4c-9fb8fb0c88dc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.421288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcbcaf33-1b14-4af1-8e4c-9fb8fb0c88dc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.428775 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:04.437474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d1fa5eef-2959-4f2f-9bf6-c84a7399f1ba tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1344 microversion: 2.1 time: 0.088528 Jan 17 02:36:04.438348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 139/278] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:04 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:04.453265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fcbcaf33-1b14-4af1-8e4c-9fb8fb0c88dc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Jan 17 02:36:04.453839 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 140/279] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:04 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:36:04.516234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-49e48713-5d3e-407f-8fb1-ec469f3a16ac tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:04.517214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-49e48713-5d3e-407f-8fb1-ec469f3a16ac tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:04.528056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49e48713-5d3e-407f-8fb1-ec469f3a16ac tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.528529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49e48713-5d3e-407f-8fb1-ec469f3a16ac tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.529437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49e48713-5d3e-407f-8fb1-ec469f3a16ac tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:04.529727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49e48713-5d3e-407f-8fb1-ec469f3a16ac tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:04.694889 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-49e48713-5d3e-407f-8fb1-ec469f3a16ac tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 27503 microversion: 2.1 time: 0.182210 Jan 17 02:36:04.696275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 140/280] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:04 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 27503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:05.078346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-200caa4b-c2c2-4830-b88c-b4c41a85cac5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:05.079857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-200caa4b-c2c2-4830-b88c-b4c41a85cac5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:05.083526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:05.084268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:05.087211 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200caa4b-c2c2-4830-b88c-b4c41a85cac5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.087669 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200caa4b-c2c2-4830-b88c-b4c41a85cac5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.088453 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200caa4b-c2c2-4830-b88c-b4c41a85cac5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.089217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200caa4b-c2c2-4830-b88c-b4c41a85cac5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.091636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.092251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.093137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.093546 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.229944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:05.237598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cc439d1b-0b28-4744-a768-fe032173a7d3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.158804 Jan 17 02:36:05.247353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 141/281] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:05 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:05.251989 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:05.252691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:05.258509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.259229 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.260003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.260471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.393010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:05.400356 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-aa7cc13c-5555-4d42-a543-95e1fe7e80a1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1503 microversion: 2.1 time: 0.151924 Jan 17 02:36:05.400887 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 142/282] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:05 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:05.455490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:05.456484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:05.465058 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.465669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.466689 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.467261 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.531586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:05.539624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4c285b0b-f3f1-42e7-9d72-8b5860868530 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1344 microversion: 2.1 time: 0.088872 Jan 17 02:36:05.540175 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 143/283] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:05 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:05.544460 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d9c3277f-378c-4eb8-bf58-49097576cf85 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:05.545349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d9c3277f-378c-4eb8-bf58-49097576cf85 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:05.550808 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9c3277f-378c-4eb8-bf58-49097576cf85 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.551244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9c3277f-378c-4eb8-bf58-49097576cf85 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.552005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9c3277f-378c-4eb8-bf58-49097576cf85 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.552485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9c3277f-378c-4eb8-bf58-49097576cf85 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.580955 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d9c3277f-378c-4eb8-bf58-49097576cf85 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039723 Jan 17 02:36:05.581507 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 144/284] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:05 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:05.709077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a51fa5f6-b962-4edd-acea-4140878ddf08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:05.709900 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a51fa5f6-b962-4edd-acea-4140878ddf08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:05.716805 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a51fa5f6-b962-4edd-acea-4140878ddf08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.717263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a51fa5f6-b962-4edd-acea-4140878ddf08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:05.718033 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a51fa5f6-b962-4edd-acea-4140878ddf08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:05.718466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a51fa5f6-b962-4edd-acea-4140878ddf08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:08.754116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a51fa5f6-b962-4edd-acea-4140878ddf08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 27802 microversion: 2.1 time: 3.048969 Jan 17 02:36:08.755252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 145/285] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:05 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 27802 bytes in 3052 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:08.763338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:08.764538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:08.773263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:08.773720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:08.774505 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:08.774940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:08.788553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-200caa4b-c2c2-4830-b88c-b4c41a85cac5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 27992 microversion: 2.20 time: 3.713745 Jan 17 02:36:08.789199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 141/286] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:05 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 27992 bytes in 3715 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:08.794289 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:08.794967 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:08.801628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:08.802069 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:08.802842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:08.803267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:08.965704 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:08.973624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-833a9b42-f0ae-4884-8b0a-4cdfa4f5fe26 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.216622 Jan 17 02:36:08.974400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 146/287] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:08 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:08.982784 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:08.983512 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:08.988498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:08.989636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:08.990085 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:08.991095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:08.991525 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:08.995879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ec2d3dda-0c5d-41f9-96b2-384ecd13eea9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1503 microversion: 2.1 time: 0.205631 Jan 17 02:36:08.996481 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 142/288] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:08 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:09.001118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-911d4a0b-5e85-478c-a90c-b769bb013d51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:09.002243 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-911d4a0b-5e85-478c-a90c-b769bb013d51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:09.008101 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-911d4a0b-5e85-478c-a90c-b769bb013d51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:09.008508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-911d4a0b-5e85-478c-a90c-b769bb013d51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:09.009292 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-911d4a0b-5e85-478c-a90c-b769bb013d51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:09.009735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-911d4a0b-5e85-478c-a90c-b769bb013d51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:09.039501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-911d4a0b-5e85-478c-a90c-b769bb013d51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 Jan 17 02:36:09.040112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 143/289] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:08 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:09.055341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:09.063244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c98f9c2a-6e55-4456-b662-85195610a60a tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1344 microversion: 2.1 time: 0.084166 Jan 17 02:36:09.063844 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 147/290] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:08 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:09.768644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-22c081ab-ff00-4ee9-8556-27ae411e1b4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:09.769481 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-22c081ab-ff00-4ee9-8556-27ae411e1b4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:09.776021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22c081ab-ff00-4ee9-8556-27ae411e1b4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:09.776509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22c081ab-ff00-4ee9-8556-27ae411e1b4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:09.777293 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22c081ab-ff00-4ee9-8556-27ae411e1b4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:09.777732 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22c081ab-ff00-4ee9-8556-27ae411e1b4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:09.800387 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7a436ab7-0fb5-4180-95fa-4613e458b549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:09.801299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7a436ab7-0fb5-4180-95fa-4613e458b549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:09.808802 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a436ab7-0fb5-4180-95fa-4613e458b549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:09.809386 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a436ab7-0fb5-4180-95fa-4613e458b549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:09.810201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a436ab7-0fb5-4180-95fa-4613e458b549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:09.810766 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a436ab7-0fb5-4180-95fa-4613e458b549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:09.925141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-22c081ab-ff00-4ee9-8556-27ae411e1b4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 27802 microversion: 2.1 time: 0.159620 Jan 17 02:36:09.926163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 144/291] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:09 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 27802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:09.990850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7a436ab7-0fb5-4180-95fa-4613e458b549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.194024 Jan 17 02:36:09.991475 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 148/292] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:09 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:09.991743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:09.992619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:09.999835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.000335 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.001125 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.001560 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.013472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:10.014148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:10.021474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.021829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.022643 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.023069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.199636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:10.202963 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:10.208137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a5e39ad3-a9e4-4709-85b4-f0959ec78d22 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.220381 Jan 17 02:36:10.209120 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 145/293] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:09 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:10.210294 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e947d0ec-0bce-4932-8a92-e8ee41e76243 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1503 microversion: 2.1 time: 0.200767 Jan 17 02:36:10.219626 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 149/294] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:10 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:10.219781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-60d99256-965d-43a0-a24d-bf61c95c1e5a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:10.219781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-60d99256-965d-43a0-a24d-bf61c95c1e5a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:10.219982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:10.219982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:10.221401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60d99256-965d-43a0-a24d-bf61c95c1e5a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.221585 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.222023 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60d99256-965d-43a0-a24d-bf61c95c1e5a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.222218 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.222876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60d99256-965d-43a0-a24d-bf61c95c1e5a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.223169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.223371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-60d99256-965d-43a0-a24d-bf61c95c1e5a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.223576 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.255390 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.255841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.256315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lazy-loading 'fault' on Instance uuid f21e2a65-a1ed-433d-92ef-fc11b3a1b233 {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:36:10.261951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-60d99256-965d-43a0-a24d-bf61c95c1e5a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051620 Jan 17 02:36:10.262749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 146/295] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:10 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:10.306222 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285013fbddcd4561b2dc4fd77570cb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9ae723aff549fe8e80022cb0e77cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:10.315721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-70ef3fe2-b707-4478-ab69-162e27df2ff6 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 200 len: 1349 microversion: 2.1 time: 0.103486 Jan 17 02:36:10.316673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 150/296] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:10 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:10.939480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fced071f-e9da-486d-b61f-7236b170f060 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:10.940434 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fced071f-e9da-486d-b61f-7236b170f060 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:10.947084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fced071f-e9da-486d-b61f-7236b170f060 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.947530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fced071f-e9da-486d-b61f-7236b170f060 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:10.948340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fced071f-e9da-486d-b61f-7236b170f060 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:10.948792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fced071f-e9da-486d-b61f-7236b170f060 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.001956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-95a1d41c-fea3-49bf-ba18-14cfa32c0fc3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:11.002989 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-95a1d41c-fea3-49bf-ba18-14cfa32c0fc3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:11.010965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95a1d41c-fea3-49bf-ba18-14cfa32c0fc3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.011488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95a1d41c-fea3-49bf-ba18-14cfa32c0fc3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.012488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95a1d41c-fea3-49bf-ba18-14cfa32c0fc3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.013004 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95a1d41c-fea3-49bf-ba18-14cfa32c0fc3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.055312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fced071f-e9da-486d-b61f-7236b170f060 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 27976 microversion: 2.1 time: 0.119406 Jan 17 02:36:11.055995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 147/297] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:10 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 27976 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:11.127549 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-95a1d41c-fea3-49bf-ba18-14cfa32c0fc3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.129129 Jan 17 02:36:11.128384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 151/298] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:10 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:11.201478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-010a1bfc-88cb-4e82-b98c-78cb8933d9c5 req-b31051c7-eafd-4d28-98fc-e2b8f61a063d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174c40e9-53cc-4bfc-a4e6-5969e5f48819", "name": "network-vif-deleted", "tag": "2a1ba1ae-6423-44f8-bcf2-4aff4fbd50a7"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:11.203219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:11.203219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:36:11.211304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-010a1bfc-88cb-4e82-b98c-78cb8933d9c5 req-b31051c7-eafd-4d28-98fc-e2b8f61a063d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.211814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-010a1bfc-88cb-4e82-b98c-78cb8933d9c5 req-b31051c7-eafd-4d28-98fc-e2b8f61a063d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.225379 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-010a1bfc-88cb-4e82-b98c-78cb8933d9c5 req-b31051c7-eafd-4d28-98fc-e2b8f61a063d service nova] Creating event network-vif-deleted:2a1ba1ae-6423-44f8-bcf2-4aff4fbd50a7 for instance 174c40e9-53cc-4bfc-a4e6-5969e5f48819 on hv-cinder-82160 Jan 17 02:36:11.227304 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:11.228169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:11.230903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-010a1bfc-88cb-4e82-b98c-78cb8933d9c5 req-b31051c7-eafd-4d28-98fc-e2b8f61a063d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033369 Jan 17 02:36:11.231904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 148/299] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:11.237486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:11.239001 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.239404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.240479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.240991 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.246887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:11.253638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.254084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.254875 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.255307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.332698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:11.340211 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d37bf175-1725-41af-b4ad-bee0b1575bf1 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 200 len: 1297 microversion: 2.1 time: 0.107250 Jan 17 02:36:11.340921 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 149/300] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:11 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:11.346115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cc9b2062-6cbb-4502-851d-599516e27137 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:11.347056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cc9b2062-6cbb-4502-851d-599516e27137 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:11.353322 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc9b2062-6cbb-4502-851d-599516e27137 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.353762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc9b2062-6cbb-4502-851d-599516e27137 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.354531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc9b2062-6cbb-4502-851d-599516e27137 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.354954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc9b2062-6cbb-4502-851d-599516e27137 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.387954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cc9b2062-6cbb-4502-851d-599516e27137 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045993 Jan 17 02:36:11.392198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 150/301] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:11 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:36:11.398654 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:11.400554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:11.401432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:11.407836 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.408387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.408497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-49a9de6a-0f20-4e5e-9bd6-dd5d55d1f23d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.185726 Jan 17 02:36:11.409106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 152/302] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:11 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:11.418197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.418197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.425068 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] HTTP exception thrown: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. Jan 17 02:36:11.425661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Returning 404 to user: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:11.426501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-680ec76e-e0c6-4e8a-8f31-53a1dfa81ca7 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 404 len: 111 microversion: 2.1 time: 0.029816 Jan 17 02:36:11.427078 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 151/303] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:11 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:36:11.532132 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:11.533051 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:11.540341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.540791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.541591 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:11.542183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:11.555991 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] HTTP exception thrown: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. Jan 17 02:36:11.556688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Returning 404 to user: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:11.557518 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-12eb9ee7-0530-4886-ad36-435ae8e37611 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029269 Jan 17 02:36:11.558105 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 153/304] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:11 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:36:11.686399 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-317065213", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "97da4c82-5c36-47e9-8cea-2b4c9d79a703"}]}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:11.744232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] validate_networks() for [('97da4c82-5c36-47e9-8cea-2b4c9d79a703', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:36:12.067226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8d89d6c6-e48b-417d-a87b-5f3f68d9bdaa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:12.068164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8d89d6c6-e48b-417d-a87b-5f3f68d9bdaa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:12.075167 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d89d6c6-e48b-417d-a87b-5f3f68d9bdaa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.075614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d89d6c6-e48b-417d-a87b-5f3f68d9bdaa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.076492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d89d6c6-e48b-417d-a87b-5f3f68d9bdaa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.077035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d89d6c6-e48b-417d-a87b-5f3f68d9bdaa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.147949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:36:12.148446 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:36:12.148914 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:36:12.149323 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:36:12.149733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:36:12.159698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.160093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.160923 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.161358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.179415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:36:12.183597 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for user d19dac2ccdf34b62bf4dc5b43c034648 and project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:36:12.188466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8d89d6c6-e48b-417d-a87b-5f3f68d9bdaa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.125176 Jan 17 02:36:12.189825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 154/305] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:12 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:36:12.195001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:36:12.195120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e0b7393e-bce9-496b-8177-c7239a007ef2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:12.196319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e0b7393e-bce9-496b-8177-c7239a007ef2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:12.197385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:36:12.203252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0b7393e-bce9-496b-8177-c7239a007ef2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.203751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0b7393e-bce9-496b-8177-c7239a007ef2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.204562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0b7393e-bce9-496b-8177-c7239a007ef2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.204990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0b7393e-bce9-496b-8177-c7239a007ef2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.248637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8fbac1dd-0f55-414c-b299-aaee301e8fbb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565742 Jan 17 02:36:12.249594 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 152/306] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:36:12.261194 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2c02faf6-40ba-4a95-8ea0-2bd4d147c602 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:12.261953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2c02faf6-40ba-4a95-8ea0-2bd4d147c602 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:12.313355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e0b7393e-bce9-496b-8177-c7239a007ef2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.121442 Jan 17 02:36:12.317443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 155/307] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:12 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:12.324336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2c02faf6-40ba-4a95-8ea0-2bd4d147c602 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:12.331729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2c02faf6-40ba-4a95-8ea0-2bd4d147c602 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1217 microversion: 2.1 time: 0.074817 Jan 17 02:36:12.332346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 153/308] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:12 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:12.359110 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:12.360532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 174c40e9-53cc-4bfc-a4e6-5969e5f48819] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:12.369515 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.373280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.375060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.375858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.393286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] HTTP exception thrown: Instance 174c40e9-53cc-4bfc-a4e6-5969e5f48819 could not be found. Jan 17 02:36:12.394533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Returning 404 to user: Instance 174c40e9-53cc-4bfc-a4e6-5969e5f48819 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:12.395443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-03e60763-3b2c-4af6-b5d1-937fd5ad04ad tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819" status: 404 len: 111 microversion: 2.1 time: 0.041479 Jan 17 02:36:12.396651 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 156/309] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:12 2022] GET /compute/v2.1/servers/174c40e9-53cc-4bfc-a4e6-5969e5f48819 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 02:36:12.425898 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:12.426593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:12.434527 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.435136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.436255 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.437080 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.518649 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1646996984", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "51c5014e-4388-4f67-9eb7-eef46e8a6fe0"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:12.579165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] validate_networks() for [('51c5014e-4388-4f67-9eb7-eef46e8a6fe0', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:36:12.708135 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:12.719462 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-35339711-cad9-4b80-a6e7-08803533981f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.297367 Jan 17 02:36:12.721596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 154/310] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:12 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:12.763480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:12.764144 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:12.773907 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.774490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.775381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.775904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.797953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] HTTP exception thrown: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. Jan 17 02:36:12.798680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Returning 404 to user: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:12.799683 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-db83d09f-9b64-4642-a179-1d002521950e tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 404 len: 111 microversion: 2.1 time: 0.041072 Jan 17 02:36:12.800413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 155/311] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:36:12 2022] DELETE /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 02:36:12.810564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:12.812304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] [instance: f21e2a65-a1ed-433d-92ef-fc11b3a1b233] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:12.819714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.820194 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.821022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:12.821452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:12.837182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] HTTP exception thrown: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. Jan 17 02:36:12.837896 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] Returning 404 to user: Instance f21e2a65-a1ed-433d-92ef-fc11b3a1b233 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:12.838834 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3c014cf6-0723-4460-812d-321a6326b0f2 tempest-DeleteServersTestJSON-1673015627 tempest-DeleteServersTestJSON-1673015627-project] 10.222.0.24 "GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233" status: 404 len: 111 microversion: 2.1 time: 0.033036 Jan 17 02:36:12.840004 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 156/312] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:12 2022] GET /compute/v2.1/servers/f21e2a65-a1ed-433d-92ef-fc11b3a1b233 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 02:36:13.095406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:36:13.096633 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:36:13.097153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:36:13.097595 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:36:13.098013 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:36:13.108046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.108185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.109011 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.109648 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.131756 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Getting quotas for project 20f3bbecadfb47dca935ac0986b088eb. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:36:13.136114 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Getting quotas for user 6ab457485fb6427ba5215ef491a03f9a and project 20f3bbecadfb47dca935ac0986b088eb. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:36:13.147350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:36:13.149736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:36:13.202663 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-97278699-7453-4efc-a176-ea1ba7492124 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:13.204887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-97278699-7453-4efc-a176-ea1ba7492124 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:13.217485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97278699-7453-4efc-a176-ea1ba7492124 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.218150 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97278699-7453-4efc-a176-ea1ba7492124 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.219130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97278699-7453-4efc-a176-ea1ba7492124 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.219708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97278699-7453-4efc-a176-ea1ba7492124 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.229966 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0a76f351-a0cc-49b4-b411-f676416f33ed tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714701 Jan 17 02:36:13.231446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 157/313] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:36:13.244359 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-274f2d43-151c-477c-af35-fa01ca7af1f3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:13.248275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-274f2d43-151c-477c-af35-fa01ca7af1f3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:13.329950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-274f2d43-151c-477c-af35-fa01ca7af1f3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:13.336433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-274f2d43-151c-477c-af35-fa01ca7af1f3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1214 microversion: 2.1 time: 0.097189 Jan 17 02:36:13.342781 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 158/314] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:13 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:13.347685 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-375cc286-d7e6-4c3b-80f1-6f3b94e9feda tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:13.348694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-375cc286-d7e6-4c3b-80f1-6f3b94e9feda tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:13.358294 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-375cc286-d7e6-4c3b-80f1-6f3b94e9feda tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.358983 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-375cc286-d7e6-4c3b-80f1-6f3b94e9feda tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.360333 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-375cc286-d7e6-4c3b-80f1-6f3b94e9feda tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.361037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-375cc286-d7e6-4c3b-80f1-6f3b94e9feda tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.394147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-97278699-7453-4efc-a176-ea1ba7492124 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.196820 Jan 17 02:36:13.395827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 157/315] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:13 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:13.403782 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:13.404970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:13.423149 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.423718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.424633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.425498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.496805 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-375cc286-d7e6-4c3b-80f1-6f3b94e9feda tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.151969 Jan 17 02:36:13.500893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 159/316] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:13 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:13.557169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:13.566909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-737859d4-2b5f-494f-9cbd-da723e0ef3ef tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1269 microversion: 2.1 time: 0.169689 Jan 17 02:36:13.571081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 158/317] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:13 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:13.737966 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:13.741406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:13.752435 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.753060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:13.753758 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:13.754198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.038240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:14.047553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-44b4e6b0-8e43-4ff3-8039-0cc6d565d7b4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.313520 Jan 17 02:36:14.048684 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 160/318] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:13 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:14.363531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:14.365082 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:14.375219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.376126 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.388770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.389449 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.405918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0b69a211-fc3f-4ae9-89fb-793e7e42a2b5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:14.407827 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0b69a211-fc3f-4ae9-89fb-793e7e42a2b5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:14.439171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b69a211-fc3f-4ae9-89fb-793e7e42a2b5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.440314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b69a211-fc3f-4ae9-89fb-793e7e42a2b5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.448554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b69a211-fc3f-4ae9-89fb-793e7e42a2b5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.449142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b69a211-fc3f-4ae9-89fb-793e7e42a2b5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.537712 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:14.545110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-96ac9100-b7f4-47a5-95d1-22dd616b9d39 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1218 microversion: 2.1 time: 0.187371 Jan 17 02:36:14.548855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 159/319] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:14 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:14.554590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6fc44d1f-0bd6-496d-affc-f1e16285bddb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:14.555725 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6fc44d1f-0bd6-496d-affc-f1e16285bddb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:14.562774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6fc44d1f-0bd6-496d-affc-f1e16285bddb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.563295 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6fc44d1f-0bd6-496d-affc-f1e16285bddb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.564099 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6fc44d1f-0bd6-496d-affc-f1e16285bddb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.564820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6fc44d1f-0bd6-496d-affc-f1e16285bddb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.759541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0b69a211-fc3f-4ae9-89fb-793e7e42a2b5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.356863 Jan 17 02:36:14.763423 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 161/320] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:14 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:36:14.765336 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:14.766029 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:14.773393 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.773839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.774625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:14.775263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:14.795748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6fc44d1f-0bd6-496d-affc-f1e16285bddb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.244339 Jan 17 02:36:14.800246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 160/321] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:14 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:15.003886 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:15.014631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c703d80c-f716-4e8b-9713-48657d0bdb6f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.252650 Jan 17 02:36:15.015424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 162/322] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:14 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:15.065392 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:15.066085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:15.078187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.078643 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.079441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.092014 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.288145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:15.296540 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d2760b22-48dc-40c4-ac9e-725a1818ac08 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1522 microversion: 2.1 time: 0.235157 Jan 17 02:36:15.297422 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 161/323] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:15 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:15.417213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-a92ca528-da85-4871-aed1-a1d2832febbf req-fa7a26f3-aaa0-4054-9c38-5ee2a0217e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d204d6-b0f5-4ea5-932d-9cdbd447c999", "tag": "45342282-34ed-4c54-b481-93d32f1a0ecf"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:15.419437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:15.419437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:36:15.429673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-a92ca528-da85-4871-aed1-a1d2832febbf req-fa7a26f3-aaa0-4054-9c38-5ee2a0217e7d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.430140 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-a92ca528-da85-4871-aed1-a1d2832febbf req-fa7a26f3-aaa0-4054-9c38-5ee2a0217e7d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.443046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-a92ca528-da85-4871-aed1-a1d2832febbf req-fa7a26f3-aaa0-4054-9c38-5ee2a0217e7d service nova] Creating event network-changed:45342282-34ed-4c54-b481-93d32f1a0ecf for instance a8d204d6-b0f5-4ea5-932d-9cdbd447c999 on hv-cinder-82160 Jan 17 02:36:15.448732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-a92ca528-da85-4871-aed1-a1d2832febbf req-fa7a26f3-aaa0-4054-9c38-5ee2a0217e7d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035080 Jan 17 02:36:15.449375 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 163/324] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:15.561770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:15.562729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:15.569227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.569674 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.570738 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.571167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.657600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:15.668447 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fadf16fb-ba4f-48bc-b2f2-aa102bc4e9e9 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1284 microversion: 2.1 time: 0.110288 Jan 17 02:36:15.669432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 162/325] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:15 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:15.771878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e483308f-a6d2-48aa-a987-86e52d6c0f16 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:15.772965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e483308f-a6d2-48aa-a987-86e52d6c0f16 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:15.785979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e483308f-a6d2-48aa-a987-86e52d6c0f16 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.789900 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e483308f-a6d2-48aa-a987-86e52d6c0f16 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.790732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e483308f-a6d2-48aa-a987-86e52d6c0f16 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.791170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e483308f-a6d2-48aa-a987-86e52d6c0f16 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.812699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-eaf5f4c0-13fd-4683-b6fb-cf070f5b5bee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:15.814073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-eaf5f4c0-13fd-4683-b6fb-cf070f5b5bee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:15.824870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaf5f4c0-13fd-4683-b6fb-cf070f5b5bee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.825973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaf5f4c0-13fd-4683-b6fb-cf070f5b5bee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.826857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaf5f4c0-13fd-4683-b6fb-cf070f5b5bee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:15.827292 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaf5f4c0-13fd-4683-b6fb-cf070f5b5bee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:15.989358 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e483308f-a6d2-48aa-a987-86e52d6c0f16 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.221964 Jan 17 02:36:15.989994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 164/326] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:15 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:16.031179 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:16.031784 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:16.039108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-eaf5f4c0-13fd-4683-b6fb-cf070f5b5bee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.233866 Jan 17 02:36:16.039318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.039542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.039976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 163/327] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:15 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:16.040354 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.043517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.171664 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:16.181937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e1a97b9b-5046-4744-8cf9-2cefe292f164 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.154750 Jan 17 02:36:16.183159 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 165/328] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:16 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:16.314080 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:16.314685 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:16.321700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.322153 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.322940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.323381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.457984 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:16.479365 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6d0ecab8-0e90-4f9a-93e7-f4b4f05a015b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1502 microversion: 2.1 time: 0.168627 Jan 17 02:36:16.480165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 164/329] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:16 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:16.495649 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:16.496287 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:16.502802 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.503254 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.504037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.504516 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.686709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:16.687266 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:16.694172 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.694967 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.697411 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:16.697872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:16.898182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:16.901981 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:16.911456 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-31a23aac-3a28-4e5d-8d3b-be6e38e5ebc4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.228515 Jan 17 02:36:16.912021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 165/330] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:16 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:16.912169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0ef591da-dd93-4db8-9d18-8f9c987d2ec9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1515 microversion: 2.1 time: 0.420081 Jan 17 02:36:16.912661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 166/331] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:16 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1515 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:17.000993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-05ba54d8-590c-4bf0-8c1a-07f6169504e6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:17.002225 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-05ba54d8-590c-4bf0-8c1a-07f6169504e6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:17.009958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-05ba54d8-590c-4bf0-8c1a-07f6169504e6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.010450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-05ba54d8-590c-4bf0-8c1a-07f6169504e6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.011400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-05ba54d8-590c-4bf0-8c1a-07f6169504e6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.012047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-05ba54d8-590c-4bf0-8c1a-07f6169504e6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.051866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-80d08ae0-2512-4e0a-9ab4-c55ec0f72810 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:17.053153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-80d08ae0-2512-4e0a-9ab4-c55ec0f72810 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:17.059580 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80d08ae0-2512-4e0a-9ab4-c55ec0f72810 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.060265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80d08ae0-2512-4e0a-9ab4-c55ec0f72810 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.061198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80d08ae0-2512-4e0a-9ab4-c55ec0f72810 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.061782 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80d08ae0-2512-4e0a-9ab4-c55ec0f72810 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.117648 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-05ba54d8-590c-4bf0-8c1a-07f6169504e6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.119513 Jan 17 02:36:17.118804 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 166/332] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:16 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:17.203559 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:17.204798 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:17.223698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.225471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.226300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.228444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.275577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-80d08ae0-2512-4e0a-9ab4-c55ec0f72810 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.227702 Jan 17 02:36:17.280119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 167/333] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:17 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:17.420571 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:17.428794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3fbe0848-3aed-4cf9-b9b3-7444862d1d2a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.233336 Jan 17 02:36:17.429608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 167/334] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:17 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:17.727396 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-709f2621-166e-49e6-af90-538bcbf77972 req-be0a0de2-a87e-4450-aa05-4e57b53e4238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8342f5e5-2a1a-491d-b1d4-d851e6e6fbce", "tag": "d44e75db-ffb2-4ea4-aa5f-60e34d9087e0"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:17.729575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:17.729575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:36:17.738398 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-709f2621-166e-49e6-af90-538bcbf77972 req-be0a0de2-a87e-4450-aa05-4e57b53e4238 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.738820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-709f2621-166e-49e6-af90-538bcbf77972 req-be0a0de2-a87e-4450-aa05-4e57b53e4238 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.751007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-709f2621-166e-49e6-af90-538bcbf77972 req-be0a0de2-a87e-4450-aa05-4e57b53e4238 service nova] Creating event network-changed:d44e75db-ffb2-4ea4-aa5f-60e34d9087e0 for instance 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce on hv-cinder-82160 Jan 17 02:36:17.755763 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-709f2621-166e-49e6-af90-538bcbf77972 req-be0a0de2-a87e-4450-aa05-4e57b53e4238 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032209 Jan 17 02:36:17.756366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 168/335] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:17.822258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2ff489c7-8c9f-4bb0-aa83-2a4595e55f2f tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074e779ee0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:17.875087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2ff489c7-8c9f-4bb0-aa83-2a4595e55f2f tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/fb15f3f8-de3e-4b8f-bce5-40aa69188aaf" status: 200 len: 351 microversion: 2.1 time: 0.056398 Jan 17 02:36:17.875687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 168/336] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:36:17 2022] GET /compute/v2.1/os-volumes/fb15f3f8-de3e-4b8f-bce5-40aa69188aaf => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:17.929854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:17.930542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:17.938251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.938968 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:17.940082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:17.940641 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.118376 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:18.130141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cf607b24-f3dd-49b6-a671-dcb03eb90d2e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:18.130326 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6af58008-698d-4013-9d26-124dac39a4b2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.205130 Jan 17 02:36:18.130908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 169/337] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:17 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:18.131129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cf607b24-f3dd-49b6-a671-dcb03eb90d2e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:18.140590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf607b24-f3dd-49b6-a671-dcb03eb90d2e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.141121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf607b24-f3dd-49b6-a671-dcb03eb90d2e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.143442 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf607b24-f3dd-49b6-a671-dcb03eb90d2e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.156586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf607b24-f3dd-49b6-a671-dcb03eb90d2e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.273513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cf607b24-f3dd-49b6-a671-dcb03eb90d2e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.148300 Jan 17 02:36:18.278876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 169/338] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:18 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:18.288279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3fecb6dc-8979-46ec-a934-49c38fcef30a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:18.289451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3fecb6dc-8979-46ec-a934-49c38fcef30a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:18.295939 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3fecb6dc-8979-46ec-a934-49c38fcef30a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.296417 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3fecb6dc-8979-46ec-a934-49c38fcef30a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.297274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3fecb6dc-8979-46ec-a934-49c38fcef30a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.297648 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3fecb6dc-8979-46ec-a934-49c38fcef30a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.322609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:18.323947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:18.331513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.331975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.332759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.333447 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.358599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lazy-loading 'flavor' on Instance uuid 24ef95ec-9461-446c-ac23-d29814c0a4fa {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:36:18.471257 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7048523d-a025-4d8c-beee-4bfd7638e1c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action" status: 200 len: 32 microversion: 2.1 time: 0.152667 Jan 17 02:36:18.472052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 170/339] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:18 2022] POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:36:18.480825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:18.481467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:18.487699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.488181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.488957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.489388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.626284 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:18.633796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6ad6b0ab-488d-4ad4-9088-50bb8c089998 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.156839 Jan 17 02:36:18.634355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 171/340] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:18 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:18.638516 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:18.639111 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:18.645265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.645716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.646488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:18.646917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:18.783069 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:18.790350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7473385d-9e40-4ac6-828a-6d01ffcf81e2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.155013 Jan 17 02:36:18.790938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 172/341] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:18 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:19.146859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:19.147547 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:19.154117 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:19.154569 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:19.155351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:19.155781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:19.301528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:19.309117 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-10636952-037f-432e-a1b4-280d1a57c4c2 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.165879 Jan 17 02:36:19.309681 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 173/342] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:19 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:19.314221 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-22615de0-c443-45cc-a59a-b978c3bb47ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:19.315211 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-22615de0-c443-45cc-a59a-b978c3bb47ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:19.320931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22615de0-c443-45cc-a59a-b978c3bb47ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:19.321380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22615de0-c443-45cc-a59a-b978c3bb47ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:19.322155 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22615de0-c443-45cc-a59a-b978c3bb47ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:19.322590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22615de0-c443-45cc-a59a-b978c3bb47ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:22.825421 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3fecb6dc-8979-46ec-a934-49c38fcef30a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 4.540413 Jan 17 02:36:22.827553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 170/343] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:18 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 4544 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:22.832693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:22.833373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:22.840384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:22.840829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:22.841180 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-22615de0-c443-45cc-a59a-b978c3bb47ed tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 3.529742 Jan 17 02:36:22.841619 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:22.845300 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:22.845448 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 174/344] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:19 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 3532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:22.846929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:22.847936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:22.854236 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:22.854679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:22.855452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:22.855877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:23.047307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:23.051695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:23.056201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4281e23d-403e-4c49-b902-af036bf8a220 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.227428 Jan 17 02:36:23.062221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 171/345] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:22 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:23.063433 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d5946f4a-a847-42aa-bf81-a6d2f2d53a56 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.219501 Jan 17 02:36:23.064228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 175/346] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:22 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:23.066318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:23.066681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:23.073384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:23.074052 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:23.075282 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:23.075911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:23.207491 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:23.214850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b89c0cf8-6d3e-41dc-a2eb-e6e844cad339 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.156994 Jan 17 02:36:23.215415 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 172/347] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:23 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:23.837613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3942596e-ed33-441e-a30e-5552f492012d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:23.838572 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3942596e-ed33-441e-a30e-5552f492012d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:23.845105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3942596e-ed33-441e-a30e-5552f492012d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:23.845675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3942596e-ed33-441e-a30e-5552f492012d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:23.846363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3942596e-ed33-441e-a30e-5552f492012d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:23.846818 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3942596e-ed33-441e-a30e-5552f492012d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:23.852716 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8178d2a4-13a5-4c8b-99a8-d269ea4b782e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:23.853694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8178d2a4-13a5-4c8b-99a8-d269ea4b782e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:23.860165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8178d2a4-13a5-4c8b-99a8-d269ea4b782e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:23.860628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8178d2a4-13a5-4c8b-99a8-d269ea4b782e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:23.861417 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8178d2a4-13a5-4c8b-99a8-d269ea4b782e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:23.861905 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8178d2a4-13a5-4c8b-99a8-d269ea4b782e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:23.958439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3942596e-ed33-441e-a30e-5552f492012d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.124319 Jan 17 02:36:23.959020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 176/348] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:23 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:24.077857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:24.078531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8178d2a4-13a5-4c8b-99a8-d269ea4b782e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.228907 Jan 17 02:36:24.078989 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:24.085214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 173/349] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:23 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:36:24.087745 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:24.088922 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:24.090279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.091022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.092383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.093104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.099643 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.100457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.101816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.102256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.291865 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:24.294842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:24.300052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-76d46c4a-6132-4458-96f0-d5640057567f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.228961 Jan 17 02:36:24.300813 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 177/350] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:24 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:24.305415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:24.306007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:24.307988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4181fd74-1f44-42eb-a9d6-49e19ce8521c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.226561 Jan 17 02:36:24.309129 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 174/351] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:24 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:24.312300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.312753 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.313523 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.313973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.408852 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1898670605", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "56a24d12-612f-4839-8346-2f43362c5e8e"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:24.454191 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:24.462044 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-863ef1c9-4db3-4c6b-a1d2-08140cc8d2d4 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.160245 Jan 17 02:36:24.462496 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] validate_networks() for [('56a24d12-612f-4839-8346-2f43362c5e8e', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:36:24.471461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 178/352] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:24 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:24.504054 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-677ac868-5f1e-40ad-abf3-5d5774f034f1 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074e763c10>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:24.551764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-677ac868-5f1e-40ad-abf3-5d5774f034f1 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/e3d0e108-10b6-44c1-b8db-81e80d5f8595" status: 200 len: 351 microversion: 2.1 time: 0.051256 Jan 17 02:36:24.552501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 179/353] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:36:24 2022] GET /compute/v2.1/os-volumes/e3d0e108-10b6-44c1-b8db-81e80d5f8595 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:24.833459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:36:24.834010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:36:24.834823 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:36:24.835251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:36:24.835669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:36:24.844918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.845372 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.846190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.846625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.867353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Getting quotas for project b1b592dcedb947f490f7fe030daba362. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:36:24.871595 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Getting quotas for user 859d11fc332245eabb21143a3fd4d143 and project b1b592dcedb947f490f7fe030daba362. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:36:24.883425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:36:24.886518 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:36:24.934120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-73fdca1e-372c-4aa6-9b9a-d6860b12448c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528954 Jan 17 02:36:24.934767 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 175/354] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 17 02:36:24.945393 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cda39e4a-0e10-4bd8-9e6f-aff0b44f089f tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:24.946230 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cda39e4a-0e10-4bd8-9e6f-aff0b44f089f tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:24.972121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f20b76cb-d934-4124-bd6f-91154591fab9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:24.973393 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f20b76cb-d934-4124-bd6f-91154591fab9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:24.980013 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f20b76cb-d934-4124-bd6f-91154591fab9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.980524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f20b76cb-d934-4124-bd6f-91154591fab9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.981311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f20b76cb-d934-4124-bd6f-91154591fab9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:24.981878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f20b76cb-d934-4124-bd6f-91154591fab9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:24.999616 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cda39e4a-0e10-4bd8-9e6f-aff0b44f089f tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:25.006747 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cda39e4a-0e10-4bd8-9e6f-aff0b44f089f tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1219 microversion: 2.1 time: 0.065818 Jan 17 02:36:25.007299 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 180/355] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:24 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:25.092834 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d483c38d-f42b-4419-ac28-6e11bfbdc3c7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:25.093846 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d483c38d-f42b-4419-ac28-6e11bfbdc3c7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:25.100244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d483c38d-f42b-4419-ac28-6e11bfbdc3c7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:25.100724 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d483c38d-f42b-4419-ac28-6e11bfbdc3c7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:25.101519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d483c38d-f42b-4419-ac28-6e11bfbdc3c7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:25.101990 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d483c38d-f42b-4419-ac28-6e11bfbdc3c7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.342361 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f20b76cb-d934-4124-bd6f-91154591fab9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 4.375759 Jan 17 02:36:29.346474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 176/356] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:24 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 4378 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:29.348945 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:29.349631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:29.356862 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.357368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.358155 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.358739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.431809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d483c38d-f42b-4419-ac28-6e11bfbdc3c7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 4.342499 Jan 17 02:36:29.433207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 181/357] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:25 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 4344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:36:29.437742 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:29.438398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:29.445424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.445839 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.446841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.447240 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.506340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:29.514700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c3768da6-0ecd-4f4f-9b27-e8afbd31593c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.169430 Jan 17 02:36:29.519829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 177/358] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:29 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:29.524393 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:29.525264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:29.531406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.532377 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.532686 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.533115 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.633199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:29.640761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-57541242-cb06-42c0-a948-03e9636891c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.206826 Jan 17 02:36:29.641365 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 182/359] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:29 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:29.645694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:29.646295 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:29.652290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.652754 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.653541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:29.653974 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:29.703057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:29.710323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7815f580-8792-4147-ad09-af94e7c63e60 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.189409 Jan 17 02:36:29.710899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 178/360] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:29 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:29.717460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:29.729278 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cb5d0f58-bfc1-4779-b7c6-c37ba2d05c11 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1271 microversion: 2.1 time: 0.086682 Jan 17 02:36:29.729829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 183/361] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:29 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:30.357720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-31bccc41-a098-463d-85c6-f8e618bc182b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:30.359528 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-31bccc41-a098-463d-85c6-f8e618bc182b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:30.369289 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31bccc41-a098-463d-85c6-f8e618bc182b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.370096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31bccc41-a098-463d-85c6-f8e618bc182b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.370875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31bccc41-a098-463d-85c6-f8e618bc182b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.371307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31bccc41-a098-463d-85c6-f8e618bc182b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.442902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c10b69ef-ff01-4f79-a66c-099410e98a76 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:30.443876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c10b69ef-ff01-4f79-a66c-099410e98a76 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:30.450390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c10b69ef-ff01-4f79-a66c-099410e98a76 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.450837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c10b69ef-ff01-4f79-a66c-099410e98a76 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.451633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c10b69ef-ff01-4f79-a66c-099410e98a76 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.452087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c10b69ef-ff01-4f79-a66c-099410e98a76 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.487804 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-31bccc41-a098-463d-85c6-f8e618bc182b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.135749 Jan 17 02:36:30.489452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 179/362] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:30 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:30.532032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:30.532671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:30.540179 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.540632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.541429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.541953 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.658684 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c10b69ef-ff01-4f79-a66c-099410e98a76 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.218930 Jan 17 02:36:30.664977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 184/363] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:30 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:30.672777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:30.674464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:30.682510 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.683626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.685418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.686081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.719202 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:30.728161 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fa6f9cf4-5113-42a3-b44a-bf623d69149d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.200114 Jan 17 02:36:30.737680 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 180/364] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:30 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:30.743012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:30.743638 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:30.749818 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.750264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.751118 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.751558 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.889108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:30.897439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6c3c0451-505d-4034-9a0e-96c445f691cb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.230753 Jan 17 02:36:30.898070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 185/365] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:30 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:30.904780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:30.905818 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:30.914160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.914620 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.915594 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:30.916053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:30.934215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:30.942399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f501dbf0-704b-4f23-a051-828f6c4d64ae tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.203144 Jan 17 02:36:30.942933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 181/366] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:30 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:30.980774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:30.988046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-564c1193-2caf-4ba2-ab51-2a099048cc1b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1277 microversion: 2.1 time: 0.088855 Jan 17 02:36:30.988646 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 186/367] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:30 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:31.501113 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a08ff2e3-9c2a-4b61-9baa-31dafbdfb737 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:31.502071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a08ff2e3-9c2a-4b61-9baa-31dafbdfb737 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:31.508050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e3-9c2a-4b61-9baa-31dafbdfb737 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:31.508530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e3-9c2a-4b61-9baa-31dafbdfb737 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:31.509310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e3-9c2a-4b61-9baa-31dafbdfb737 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:31.509830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e3-9c2a-4b61-9baa-31dafbdfb737 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:31.670908 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d148b1f6-ef43-494f-b102-b094544b463e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:31.671948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d148b1f6-ef43-494f-b102-b094544b463e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:31.678716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d148b1f6-ef43-494f-b102-b094544b463e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:31.679156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d148b1f6-ef43-494f-b102-b094544b463e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:31.679896 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d148b1f6-ef43-494f-b102-b094544b463e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:31.680386 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d148b1f6-ef43-494f-b102-b094544b463e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.396494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a08ff2e3-9c2a-4b61-9baa-31dafbdfb737 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 4.899044 Jan 17 02:36:36.397144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 182/368] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:31 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 4902 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:36.402809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:36.403484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:36.410844 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.411296 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.412049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.412531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.433868 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d148b1f6-ef43-494f-b102-b094544b463e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 4.766441 Jan 17 02:36:36.435644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 187/369] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:31 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 4769 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:36.440881 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:36.441644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:36.448477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.449013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.449905 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.450398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.599172 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:36.606595 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-909a167f-2c59-4d36-9585-d2d8d8a21c0a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.207893 Jan 17 02:36:36.616197 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 183/370] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:36 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:36.616197 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:36.616197 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:36.618007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.618452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.619227 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.619658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.638197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:36.645995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dc9a9c71-b148-4b9b-8382-56c65ce4e4e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.208934 Jan 17 02:36:36.646795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 188/371] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:36 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:36.651306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:36.652106 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:36.658022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.658476 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.659601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.660041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.790422 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:36.798349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-43cf646c-c1e0-4890-9805-0571889f4f51 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.190099 Jan 17 02:36:36.799146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 184/372] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:36 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:36.803120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0bce35de-02a6-481b-ab43-3e6a0cdbc760 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074dd8fd30>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:36.836489 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:36.843992 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d6a9e61e-596e-4fec-adbc-3f86484314e1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.196090 Jan 17 02:36:36.844925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 189/373] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:36 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:36.855670 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0bce35de-02a6-481b-ab43-3e6a0cdbc760 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/69d67543-fce3-46f7-9fdf-60942239a196" status: 200 len: 350 microversion: 2.1 time: 0.055703 Jan 17 02:36:36.856264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 185/374] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:36:36 2022] GET /compute/v2.1/os-volumes/69d67543-fce3-46f7-9fdf-60942239a196 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:36.867666 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ef3a23a9-e160-4e56-91c9-65018b95d225 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074e743d30>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:36.949749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ef3a23a9-e160-4e56-91c9-65018b95d225 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085985 Jan 17 02:36:36.950573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 190/375] 10.222.0.24 () {58 vars in 1133 bytes} [Mon Jan 17 02:36:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:36.959104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-2eb9a6c2-bfac-4562-9035-3c1a1f6cef83 req-9e1e1a59-78be-4e70-a9c1-5c8ce2df87f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8714ff-adae-40c0-a96e-9b7ddfee2781", "tag": "bc96ff8b-35ce-4e5f-a90f-67cd4c7dc88b"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:36.959104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:36.959104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:36:36.967260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-2eb9a6c2-bfac-4562-9035-3c1a1f6cef83 req-9e1e1a59-78be-4e70-a9c1-5c8ce2df87f9 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:36.967696 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-2eb9a6c2-bfac-4562-9035-3c1a1f6cef83 req-9e1e1a59-78be-4e70-a9c1-5c8ce2df87f9 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:36.973634 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c9bbee97-3871-433f-b4e4-7904cff56378 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074e65edc0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:36.977902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-2eb9a6c2-bfac-4562-9035-3c1a1f6cef83 req-9e1e1a59-78be-4e70-a9c1-5c8ce2df87f9 service nova] Creating event network-changed:bc96ff8b-35ce-4e5f-a90f-67cd4c7dc88b for instance fe8714ff-adae-40c0-a96e-9b7ddfee2781 on hv-cinder-82160 Jan 17 02:36:36.982660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-2eb9a6c2-bfac-4562-9035-3c1a1f6cef83 req-9e1e1a59-78be-4e70-a9c1-5c8ce2df87f9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042202 Jan 17 02:36:36.985238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 186/376] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:36:37.055242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c9bbee97-3871-433f-b4e4-7904cff56378 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085708 Jan 17 02:36:37.055828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 191/377] 10.222.0.24 () {58 vars in 1148 bytes} [Mon Jan 17 02:36:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:37.067873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6965f07d-c777-4b22-b6f9-d027b12e1fe1 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074defe5e0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.150610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6965f07d-c777-4b22-b6f9-d027b12e1fe1 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086378 Jan 17 02:36:37.151442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 187/378] 10.222.0.24 () {58 vars in 1133 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:37.162705 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3889beb7-8a8c-473a-b73f-5e451e85ac70 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074e7580d0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.245296 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3889beb7-8a8c-473a-b73f-5e451e85ac70 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086409 Jan 17 02:36:37.246052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 192/379] 10.222.0.24 () {58 vars in 1166 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:37.258428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-74a5be13-a0f9-43f3-82d2-9e8d0f11795f tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074ddd21f0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.348274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-74a5be13-a0f9-43f3-82d2-9e8d0f11795f tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094555 Jan 17 02:36:37.349213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 188/380] 10.222.0.24 () {58 vars in 1169 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:37.369169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8b7d9706-f02d-48c6-aa29-2e95b6df91c2 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074e73fdc0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.409982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-77de9877-d745-4536-a85a-fa36c9043dc8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:37.410420 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-77de9877-d745-4536-a85a-fa36c9043dc8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:37.417142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77de9877-d745-4536-a85a-fa36c9043dc8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.417961 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77de9877-d745-4536-a85a-fa36c9043dc8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.418958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77de9877-d745-4536-a85a-fa36c9043dc8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.419389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77de9877-d745-4536-a85a-fa36c9043dc8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.467052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8b7d9706-f02d-48c6-aa29-2e95b6df91c2 tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.109763 Jan 17 02:36:37.467819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 193/381] 10.222.0.24 () {58 vars in 1154 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:37.472330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d708dd17-2661-4475-9aaa-62ca618231b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:37.473274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d708dd17-2661-4475-9aaa-62ca618231b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:37.483879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d708dd17-2661-4475-9aaa-62ca618231b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.484638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d708dd17-2661-4475-9aaa-62ca618231b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.486359 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d708dd17-2661-4475-9aaa-62ca618231b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.487148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d708dd17-2661-4475-9aaa-62ca618231b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.638053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d708dd17-2661-4475-9aaa-62ca618231b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.168840 Jan 17 02:36:37.638959 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 194/382] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:37 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:37.644088 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a024c6a1-9628-4fab-96bd-3d7c64f4dc9b tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074e73f670>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.664559 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-77de9877-d745-4536-a85a-fa36c9043dc8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.259679 Jan 17 02:36:37.665543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 189/383] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:37 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:37.670892 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-fd3097ce-53c8-402b-aef7-b29bad7a0420 req-681a7d80-74e1-4d01-955c-7447b5b34a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d204d6-b0f5-4ea5-932d-9cdbd447c999", "name": "network-vif-plugged", "status": "completed", "tag": "45342282-34ed-4c54-b481-93d32f1a0ecf"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:37.672446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:37.672446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:36:37.682426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-fd3097ce-53c8-402b-aef7-b29bad7a0420 req-681a7d80-74e1-4d01-955c-7447b5b34a5d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.682968 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-fd3097ce-53c8-402b-aef7-b29bad7a0420 req-681a7d80-74e1-4d01-955c-7447b5b34a5d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.695384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-fd3097ce-53c8-402b-aef7-b29bad7a0420 req-681a7d80-74e1-4d01-955c-7447b5b34a5d service nova] Creating event network-vif-plugged:45342282-34ed-4c54-b481-93d32f1a0ecf for instance a8d204d6-b0f5-4ea5-932d-9cdbd447c999 on hv-cinder-82160 Jan 17 02:36:37.702095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-fd3097ce-53c8-402b-aef7-b29bad7a0420 req-681a7d80-74e1-4d01-955c-7447b5b34a5d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034991 Jan 17 02:36:37.702683 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 190/384] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:37.707517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.708242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:37.714785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.715234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.716018 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.716519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.733470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a024c6a1-9628-4fab-96bd-3d7c64f4dc9b tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093119 Jan 17 02:36:37.734169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 195/385] 10.222.0.24 () {58 vars in 1187 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:37.748490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.749038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:37.756820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.757267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.758054 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.758487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.893642 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:37.902201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-14c1458e-c80b-4f72-83a2-42f1652ae3a9 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.198292 Jan 17 02:36:37.913221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 191/386] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:37.919106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-662d5d9f-d352-43bb-b810-d39d1dfef49f tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] Calling method '.version_select at 0x7f074dd98b80>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.952671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:37.962998 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3bfa3f3c-1ca0-4dd4-8a1f-6852f2ecdb0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.218263 Jan 17 02:36:37.964758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 196/387] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:37.977517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:37.978241 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:37.985954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.986480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:37.987333 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:37.987940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:38.201980 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-662d5d9f-d352-43bb-b810-d39d1dfef49f tempest-VolumesTestJSON-1226067098 tempest-VolumesTestJSON-1226067098-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.286470 Jan 17 02:36:38.214533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 192/388] 10.222.0.24 () {58 vars in 1154 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:38.214533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:38.214533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:38.215065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:38.215177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:38.215177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:38.215894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:38.216350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:38.217084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3b5b3599-1c38-4b4c-af92-ab2c96c109dd tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.250640 Jan 17 02:36:38.219177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 197/389] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:37 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:38.373527 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:38.380683 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-82257357-ce71-4129-bbc1-8a7ad91608ab tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.177204 Jan 17 02:36:38.381270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 193/390] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:38 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:38.650825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4694e64f-24fb-4cec-9a41-e786759c1641 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:38.651858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4694e64f-24fb-4cec-9a41-e786759c1641 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:38.658176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4694e64f-24fb-4cec-9a41-e786759c1641 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:38.658627 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4694e64f-24fb-4cec-9a41-e786759c1641 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:38.659744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4694e64f-24fb-4cec-9a41-e786759c1641 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:38.660212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4694e64f-24fb-4cec-9a41-e786759c1641 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:38.676654 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7046f1b8-26f9-4ea0-a19d-b0ea831652d1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:38.677618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7046f1b8-26f9-4ea0-a19d-b0ea831652d1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:38.683971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7046f1b8-26f9-4ea0-a19d-b0ea831652d1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:38.684488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7046f1b8-26f9-4ea0-a19d-b0ea831652d1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:38.685273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7046f1b8-26f9-4ea0-a19d-b0ea831652d1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:38.685700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7046f1b8-26f9-4ea0-a19d-b0ea831652d1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.293706 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7046f1b8-26f9-4ea0-a19d-b0ea831652d1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.620634 Jan 17 02:36:39.294717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 194/391] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:38 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:39.299637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:39.300344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:39.307200 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.307647 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.308492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.308926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.316115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4694e64f-24fb-4cec-9a41-e786759c1641 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.668795 Jan 17 02:36:39.316870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 198/392] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:38 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:39.322554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:39.323331 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:39.330412 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.330859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.331626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.332057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.534465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:39.542889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:39.543918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6555c61f-4470-4e06-a229-683d81890817 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.247831 Jan 17 02:36:39.553717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 195/393] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:39 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:39.553717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:39.553717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:39.554056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-62150da7-b78f-43ec-b979-e07b31a5520d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.232274 Jan 17 02:36:39.554056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 199/394] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:39 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:39.556105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:39.556602 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.556710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:39.557070 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.557886 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.558330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.562632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.563081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.564036 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:39.564794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:39.750021 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:39.761294 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:39.766908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6b396f78-e91f-4901-b042-5613afab0ab3 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.220817 Jan 17 02:36:39.767735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 196/395] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:39 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:39.771185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0caa3361-5038-49e5-ae72-a07bcb5fbf8b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.218555 Jan 17 02:36:39.772028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 200/396] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:39 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:40.305469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-380d3b07-3732-4c54-b211-6d65dcb51f96 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:40.306459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-380d3b07-3732-4c54-b211-6d65dcb51f96 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:40.313305 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-380d3b07-3732-4c54-b211-6d65dcb51f96 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.313902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-380d3b07-3732-4c54-b211-6d65dcb51f96 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.314713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-380d3b07-3732-4c54-b211-6d65dcb51f96 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.315230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-380d3b07-3732-4c54-b211-6d65dcb51f96 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.327773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3ed73edd-7794-4490-bc53-e58f305dff72 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:40.328746 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3ed73edd-7794-4490-bc53-e58f305dff72 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:40.335188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3ed73edd-7794-4490-bc53-e58f305dff72 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.335637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3ed73edd-7794-4490-bc53-e58f305dff72 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.336416 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3ed73edd-7794-4490-bc53-e58f305dff72 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.336846 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3ed73edd-7794-4490-bc53-e58f305dff72 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.542270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3ed73edd-7794-4490-bc53-e58f305dff72 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.217897 Jan 17 02:36:40.543192 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 201/397] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:40 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:40.560796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:40.561405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:40.563175 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-380d3b07-3732-4c54-b211-6d65dcb51f96 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.261461 Jan 17 02:36:40.564008 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 197/398] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:40 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:40.568885 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.569117 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.569232 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:40.569828 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:40.569929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.570327 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.576472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.576924 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.577708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.578139 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.758395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:40.761688 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:40.767071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-14f1f461-7bf3-44ce-96f0-3d81ba83affb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.201762 Jan 17 02:36:40.767705 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 198/399] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:40 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:40.769554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-655c635c-1b28-46f8-b9c6-ac0378e78a3b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1317 microversion: 2.1 time: 0.212973 Jan 17 02:36:40.770109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 202/400] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:40 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:40.784569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:40.785170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:40.788308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:40.788940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:40.791609 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.792092 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.792894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.793329 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.795268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.795712 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.796520 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:40.796987 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:40.989397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:40.993491 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:40.998207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b597e2bd-c595-4c51-b4bc-3673e459f99f tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.217314 Jan 17 02:36:40.998804 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 199/401] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:40 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:41.002330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5cbb7cbf-ef66-4035-8516-b41a28fb59e5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.217429 Jan 17 02:36:41.002886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 203/402] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:40 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:41.435182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-bf3371a2-4fb6-485f-aebe-9da565eca491 req-ef817e27-873f-4def-9211-0f01d4ae7eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8342f5e5-2a1a-491d-b1d4-d851e6e6fbce", "name": "network-vif-plugged", "status": "completed", "tag": "d44e75db-ffb2-4ea4-aa5f-60e34d9087e0"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:41.437103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:41.437103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:36:41.446080 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-bf3371a2-4fb6-485f-aebe-9da565eca491 req-ef817e27-873f-4def-9211-0f01d4ae7eaf service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.447532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-bf3371a2-4fb6-485f-aebe-9da565eca491 req-ef817e27-873f-4def-9211-0f01d4ae7eaf service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.460381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-bf3371a2-4fb6-485f-aebe-9da565eca491 req-ef817e27-873f-4def-9211-0f01d4ae7eaf service nova] Creating event network-vif-plugged:d44e75db-ffb2-4ea4-aa5f-60e34d9087e0 for instance 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce on hv-cinder-82160 Jan 17 02:36:41.466187 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-bf3371a2-4fb6-485f-aebe-9da565eca491 req-ef817e27-873f-4def-9211-0f01d4ae7eaf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035166 Jan 17 02:36:41.467170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 200/403] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:41.555124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3cd86365-d352-40b1-bae5-4326efc1c9cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:41.556100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3cd86365-d352-40b1-bae5-4326efc1c9cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:41.562642 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3cd86365-d352-40b1-bae5-4326efc1c9cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.563084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3cd86365-d352-40b1-bae5-4326efc1c9cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.563853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3cd86365-d352-40b1-bae5-4326efc1c9cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.564341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3cd86365-d352-40b1-bae5-4326efc1c9cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.575392 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ef720c11-5efe-4800-97db-105eb9143da9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:41.576568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ef720c11-5efe-4800-97db-105eb9143da9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:41.583392 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef720c11-5efe-4800-97db-105eb9143da9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.583539 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef720c11-5efe-4800-97db-105eb9143da9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.584700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef720c11-5efe-4800-97db-105eb9143da9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.585407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef720c11-5efe-4800-97db-105eb9143da9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.737687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3cd86365-d352-40b1-bae5-4326efc1c9cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.186208 Jan 17 02:36:41.738432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 204/404] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:41 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:41.765467 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ef720c11-5efe-4800-97db-105eb9143da9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.194113 Jan 17 02:36:41.767622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 201/405] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:41 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:41.785072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:41.786372 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:41.787774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:41.788529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:41.794970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.795697 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.796557 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.796994 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.798004 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.798674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:41.800327 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:41.801041 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.063318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:42.066523 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:42.072087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7514dc04-7a15-494c-bd24-ac211d407e42 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1506 microversion: 2.1 time: 0.289491 Jan 17 02:36:42.073041 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 202/406] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:41 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:42.077739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:42.078341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:42.085311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.085958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.086085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-162b0922-4390-4a39-aa94-7e71ff57ebd5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.305763 Jan 17 02:36:42.086761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 205/407] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:41 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:42.091427 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.091427 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.096507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:42.097111 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:42.103590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.104289 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.105238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.105872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.351890 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:42.358066 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:42.362908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dc999702-7657-4db9-a5d9-501856f5aa50 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.288674 Jan 17 02:36:42.365273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 203/408] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:42 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:42.365809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6c107c37-cf98-4a7c-8537-cd29aa4ff8a5 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.272779 Jan 17 02:36:42.366522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 206/409] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:42 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:42.749005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dcf237e0-2b22-438f-bc71-f645f216e893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:42.749994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dcf237e0-2b22-438f-bc71-f645f216e893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:42.755790 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dcf237e0-2b22-438f-bc71-f645f216e893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.756289 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dcf237e0-2b22-438f-bc71-f645f216e893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.757087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dcf237e0-2b22-438f-bc71-f645f216e893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.757526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dcf237e0-2b22-438f-bc71-f645f216e893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.777445 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-955796fb-beae-485e-b577-8e2c3e404a92 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:42.778503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-955796fb-beae-485e-b577-8e2c3e404a92 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:42.784824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-955796fb-beae-485e-b577-8e2c3e404a92 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.785263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-955796fb-beae-485e-b577-8e2c3e404a92 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.786781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-955796fb-beae-485e-b577-8e2c3e404a92 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:42.787224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-955796fb-beae-485e-b577-8e2c3e404a92 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:42.892113 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dcf237e0-2b22-438f-bc71-f645f216e893 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.146932 Jan 17 02:36:42.893461 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 204/410] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:42 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:42.986105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-955796fb-beae-485e-b577-8e2c3e404a92 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.211976 Jan 17 02:36:42.986965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 207/411] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:42 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:43.103182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:43.103973 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:43.111201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.111964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.113037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.113528 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.288302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:43.299170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-462c2f6c-92de-4b5d-b4e8-a4b13d98ef53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.200051 Jan 17 02:36:43.308535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 205/412] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:43 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:43.384626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:43.384985 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:43.386078 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:43.386693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:43.394736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.396055 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.397235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.397353 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.397692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.398335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.399644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.400519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.638005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:43.645475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-974c3338-406c-4ca3-8cbc-07f583ee1577 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1314 microversion: 2.1 time: 0.265811 Jan 17 02:36:43.650345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 208/413] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:43 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:43.651430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:43.658502 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d81cdd81-9ff1-4b7c-a5cd-cf8095dd1d87 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d79ac0cb-2cda-4dbc-a227-3a72161f7350"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:43.660168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c53dece4-0d3a-463f-b2cc-1cc8fc100d37 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.279405 Jan 17 02:36:43.661101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 206/414] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:43 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:43.663011 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d81cdd81-9ff1-4b7c-a5cd-cf8095dd1d87 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:43.675512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d81cdd81-9ff1-4b7c-a5cd-cf8095dd1d87 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.676188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d81cdd81-9ff1-4b7c-a5cd-cf8095dd1d87 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.677361 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d81cdd81-9ff1-4b7c-a5cd-cf8095dd1d87 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.678917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d81cdd81-9ff1-4b7c-a5cd-cf8095dd1d87 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.903806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1320c373-edf2-4beb-9bfb-395d37d2ed58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:43.904677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1320c373-edf2-4beb-9bfb-395d37d2ed58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:43.911564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1320c373-edf2-4beb-9bfb-395d37d2ed58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.911914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1320c373-edf2-4beb-9bfb-395d37d2ed58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.914486 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1320c373-edf2-4beb-9bfb-395d37d2ed58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:43.914931 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1320c373-edf2-4beb-9bfb-395d37d2ed58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:43.980409 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d81cdd81-9ff1-4b7c-a5cd-cf8095dd1d87 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328752 Jan 17 02:36:43.981037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 209/415] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:36:43 2022] POST /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:44.000839 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-79184495-a847-43ed-ac20-32eb506832a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:44.002047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-79184495-a847-43ed-ac20-32eb506832a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:44.010067 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-79184495-a847-43ed-ac20-32eb506832a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.010556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-79184495-a847-43ed-ac20-32eb506832a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.011607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-79184495-a847-43ed-ac20-32eb506832a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.012204 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-79184495-a847-43ed-ac20-32eb506832a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.162280 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-79184495-a847-43ed-ac20-32eb506832a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28108 microversion: 2.20 time: 0.165958 Jan 17 02:36:44.164637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 210/416] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:43 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28108 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:44.233628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1320c373-edf2-4beb-9bfb-395d37d2ed58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.333949 Jan 17 02:36:44.234273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 207/417] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:43 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:44.317252 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:44.318119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:44.325790 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.326247 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.327052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.327680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.640740 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:44.654238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-78184031-23f9-47b7-b969-af78eb82b30b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.341602 Jan 17 02:36:44.655090 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 211/418] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:44 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:44.670174 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:44.670940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:44.681575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:44.682426 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:44.687895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.689065 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.690555 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.691149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.693971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.694438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.697192 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:44.697656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:44.952637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:44.956883 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:44.963982 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b4dd71d9-5b1d-4418-8078-ec5c126e117e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.286343 Jan 17 02:36:44.964940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 212/419] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:44 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:44.974201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-be26d040-9501-4738-8566-634f29afb340 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1499 microversion: 2.1 time: 0.299613 Jan 17 02:36:44.974897 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 208/420] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:44 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1499 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:45.175910 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dc114c73-d8f8-48b4-a2db-cd23d74e7c8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:45.177136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-dc114c73-d8f8-48b4-a2db-cd23d74e7c8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:45.196519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc114c73-d8f8-48b4-a2db-cd23d74e7c8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.197581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc114c73-d8f8-48b4-a2db-cd23d74e7c8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.199310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc114c73-d8f8-48b4-a2db-cd23d74e7c8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.200173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dc114c73-d8f8-48b4-a2db-cd23d74e7c8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.248145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-72d337e2-9d11-4111-87df-72fe7de7059b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:45.249147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-72d337e2-9d11-4111-87df-72fe7de7059b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:45.284305 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-72d337e2-9d11-4111-87df-72fe7de7059b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.285012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-72d337e2-9d11-4111-87df-72fe7de7059b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.286165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-72d337e2-9d11-4111-87df-72fe7de7059b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.287618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-72d337e2-9d11-4111-87df-72fe7de7059b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.416051 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dc114c73-d8f8-48b4-a2db-cd23d74e7c8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28233 microversion: 2.20 time: 0.244863 Jan 17 02:36:45.417656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 213/421] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:45 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28233 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:45.487722 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-72d337e2-9d11-4111-87df-72fe7de7059b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28164 microversion: 2.1 time: 0.243944 Jan 17 02:36:45.489497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 209/422] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:45 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28164 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:45.672961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:45.673631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:45.681000 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.681748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.682537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.683166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.803633 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:45.804898 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:45.813089 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.813881 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.814868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.815493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.846532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:36:45.904285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:45.914479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c2838c8d-34d5-439e-b274-2e461d94ee0d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.245663 Jan 17 02:36:45.927484 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 214/423] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:45 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:45.974219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-77dcd0c0-302f-49ce-8fab-74bddd44104e tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 204 len: 0 microversion: 2.1 time: 0.174822 Jan 17 02:36:45.976443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 210/424] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:36:45 2022] DELETE /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 17 02:36:45.982182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:45.982784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:45.986925 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:45.987621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:45.993989 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.994447 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.994942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.995545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.995871 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.996451 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:45.996602 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:45.997940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:46.236739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:46.252388 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-60dc0f4a-89de-4dee-aea0-ad86824b796c tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1505 microversion: 2.1 time: 0.270047 Jan 17 02:36:46.252998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 211/425] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:45 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:46.305053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:46.320375 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f25dbe87-b8a9-4479-9e9c-11bb0973b7fa tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.342541 Jan 17 02:36:46.321287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 215/426] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:45 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:46.430200 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-95578033-1216-4c0d-8d86-4d0ee0a9b782 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:46.431206 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-95578033-1216-4c0d-8d86-4d0ee0a9b782 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:46.438302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95578033-1216-4c0d-8d86-4d0ee0a9b782 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:46.438869 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95578033-1216-4c0d-8d86-4d0ee0a9b782 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:46.439926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95578033-1216-4c0d-8d86-4d0ee0a9b782 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:46.441263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95578033-1216-4c0d-8d86-4d0ee0a9b782 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:46.500409 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-82214f18-c7c5-4f65-af58-72e5bf794482 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:46.501364 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-82214f18-c7c5-4f65-af58-72e5bf794482 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:46.507763 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82214f18-c7c5-4f65-af58-72e5bf794482 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:46.508289 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82214f18-c7c5-4f65-af58-72e5bf794482 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:46.509102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82214f18-c7c5-4f65-af58-72e5bf794482 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:46.509545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82214f18-c7c5-4f65-af58-72e5bf794482 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:46.593543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-95578033-1216-4c0d-8d86-4d0ee0a9b782 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28398 microversion: 2.20 time: 0.168495 Jan 17 02:36:46.594538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 212/427] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:46 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28398 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:46.655892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-82214f18-c7c5-4f65-af58-72e5bf794482 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28307 microversion: 2.1 time: 0.158695 Jan 17 02:36:46.656589 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 216/428] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:46 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:46.935460 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:46.936384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:46.943956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:46.944562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:46.945432 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:46.945938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.114007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:47.122285 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ae99dcf5-ad0e-49b5-9cd9-1716a778262c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.191996 Jan 17 02:36:47.131653 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 213/429] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:46 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:47.272956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:47.273661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:47.285992 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.286717 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.287741 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.288314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.350725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:47.351433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:47.358469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.359121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.360700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.361280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.578849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:47.588859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b5a226bc-8ca7-4968-9f38-1f0ee3c3cf7b tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1505 microversion: 2.1 time: 0.321996 Jan 17 02:36:47.594021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 217/430] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:47 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:47.605079 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e033e2ea-50ce-4180-969e-f0f151598cca tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:47.608049 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e033e2ea-50ce-4180-969e-f0f151598cca tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:47.623177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e033e2ea-50ce-4180-969e-f0f151598cca tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.628328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e033e2ea-50ce-4180-969e-f0f151598cca tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.630255 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e033e2ea-50ce-4180-969e-f0f151598cca tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.636808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e033e2ea-50ce-4180-969e-f0f151598cca tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.731465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:47.743829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0496cb47-1481-46ef-ad55-bff75ced830e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.409978 Jan 17 02:36:47.744741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 214/431] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:47 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:47.751290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a1be8d81-81e0-456e-8e1c-fc74c66019d0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:47.752501 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a1be8d81-81e0-456e-8e1c-fc74c66019d0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:47.759719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a1be8d81-81e0-456e-8e1c-fc74c66019d0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.760622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a1be8d81-81e0-456e-8e1c-fc74c66019d0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.761715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a1be8d81-81e0-456e-8e1c-fc74c66019d0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:47.762303 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a1be8d81-81e0-456e-8e1c-fc74c66019d0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:47.785108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e033e2ea-50ce-4180-969e-f0f151598cca tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28398 microversion: 2.20 time: 0.183446 Jan 17 02:36:47.786153 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 218/432] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:47 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28398 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:47.878718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a1be8d81-81e0-456e-8e1c-fc74c66019d0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28455 microversion: 2.1 time: 0.132345 Jan 17 02:36:47.880121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 215/433] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:47 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:48.105483 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-6d80e29c-0b4d-49ba-9c9e-f9375378da5b req-7be2eb58-fdc7-4fa9-bddf-4cf997b073fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8714ff-adae-40c0-a96e-9b7ddfee2781", "name": "network-vif-plugged", "status": "completed", "tag": "bc96ff8b-35ce-4e5f-a90f-67cd4c7dc88b"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:48.107325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:48.107325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:36:48.119433 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-6d80e29c-0b4d-49ba-9c9e-f9375378da5b req-7be2eb58-fdc7-4fa9-bddf-4cf997b073fa service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.120370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-6d80e29c-0b4d-49ba-9c9e-f9375378da5b req-7be2eb58-fdc7-4fa9-bddf-4cf997b073fa service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.139606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:48.140338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:48.146542 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-6d80e29c-0b4d-49ba-9c9e-f9375378da5b req-7be2eb58-fdc7-4fa9-bddf-4cf997b073fa service nova] Creating event network-vif-plugged:bc96ff8b-35ce-4e5f-a90f-67cd4c7dc88b for instance fe8714ff-adae-40c0-a96e-9b7ddfee2781 on hv-cinder-82160 Jan 17 02:36:48.153755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-6d80e29c-0b4d-49ba-9c9e-f9375378da5b req-7be2eb58-fdc7-4fa9-bddf-4cf997b073fa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051992 Jan 17 02:36:48.155222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 219/434] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:48.166607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.171617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.173442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.174430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.459664 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:48.479368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7dfc6bcb-248c-44f3-a333-404d90575320 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1501 microversion: 2.1 time: 0.342949 Jan 17 02:36:48.494506 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 216/435] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:48 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1501 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:48.497439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3dc5961-4c86-43e8-be63-ee5c94c021a9"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:48.498652 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:48.528631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.529764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.532000 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.532628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.576497 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] HTTP exception thrown: Cannot 'attach_volume' instance 24ef95ec-9461-446c-ac23-d29814c0a4fa while it is in vm_state rescued Jan 17 02:36:48.578070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Returning 409 to user: Cannot 'attach_volume' instance 24ef95ec-9461-446c-ac23-d29814c0a4fa while it is in vm_state rescued {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:48.579084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5e63b2db-cb4d-48de-8b06-7dcb9aaa4644 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.086163 Jan 17 02:36:48.580639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 220/436] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:36:48 2022] POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 17 02:36:48.598259 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-52e50580-8619-4a79-b59d-c2b3bd6e1725 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:48.599674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-52e50580-8619-4a79-b59d-c2b3bd6e1725 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:48.609845 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52e50580-8619-4a79-b59d-c2b3bd6e1725 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.610557 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52e50580-8619-4a79-b59d-c2b3bd6e1725 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.612381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52e50580-8619-4a79-b59d-c2b3bd6e1725 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.613326 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52e50580-8619-4a79-b59d-c2b3bd6e1725 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.616182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:48.617020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:48.629432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.629889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.632174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.633337 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.744653 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-52e50580-8619-4a79-b59d-c2b3bd6e1725 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action" status: 202 len: 0 microversion: 2.1 time: 0.155253 Jan 17 02:36:48.745445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 217/437] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:48 2022] POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:48.759990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:48.761022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:48.774554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.775244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.776269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.776947 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.923449 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:48.933146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-441105c6-9ff7-4f48-b666-44bb25ff8206 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1505 microversion: 2.1 time: 0.325743 Jan 17 02:36:48.933729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 221/438] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:48 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:36:48.946749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:48.947632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:48.963719 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.964487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:48.965467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:48.966114 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:49.105221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:49.118497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-eebde2fa-d7c1-4734-8c51-039fe8228d31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1509 microversion: 2.1 time: 0.368350 Jan 17 02:36:49.124034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 218/439] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:48 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:49.136534 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ccf8d1db-3a90-4ca8-93b2-54a97f8caca2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:49.137522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ccf8d1db-3a90-4ca8-93b2-54a97f8caca2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:49.166213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ccf8d1db-3a90-4ca8-93b2-54a97f8caca2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:49.168825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ccf8d1db-3a90-4ca8-93b2-54a97f8caca2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:49.169854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ccf8d1db-3a90-4ca8-93b2-54a97f8caca2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:49.170501 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ccf8d1db-3a90-4ca8-93b2-54a97f8caca2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:49.220300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:49.230274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-45a83d67-7282-4e8d-b3d7-b27957a5bed2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.287479 Jan 17 02:36:49.235183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 222/440] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:48 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:49.244597 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1dd1e1aa-ba9e-4369-b038-6a89312aa719 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:49.245525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1dd1e1aa-ba9e-4369-b038-6a89312aa719 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:49.261242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1dd1e1aa-ba9e-4369-b038-6a89312aa719 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:49.261739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1dd1e1aa-ba9e-4369-b038-6a89312aa719 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:49.264273 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1dd1e1aa-ba9e-4369-b038-6a89312aa719 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:49.264964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1dd1e1aa-ba9e-4369-b038-6a89312aa719 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:49.532246 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ccf8d1db-3a90-4ca8-93b2-54a97f8caca2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.406090 Jan 17 02:36:49.533854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 219/441] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:49 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:49.569560 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1dd1e1aa-ba9e-4369-b038-6a89312aa719 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.332588 Jan 17 02:36:49.570229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 223/442] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:49 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:49.963136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-3eaf5c47-6392-49a0-b31b-d175d789a18b req-f5d8c8ad-586c-476e-a3b4-3bd85948f6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8342f5e5-2a1a-491d-b1d4-d851e6e6fbce", "name": "network-vif-deleted", "tag": "d44e75db-ffb2-4ea4-aa5f-60e34d9087e0"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:49.964371 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:49.966796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:49.969434 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:36:49.969434 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:36:50.008118 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.008990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.010586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.011336 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.013010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-3eaf5c47-6392-49a0-b31b-d175d789a18b req-f5d8c8ad-586c-476e-a3b4-3bd85948f6ff service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.016717 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-3eaf5c47-6392-49a0-b31b-d175d789a18b req-f5d8c8ad-586c-476e-a3b4-3bd85948f6ff service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.041426 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-3eaf5c47-6392-49a0-b31b-d175d789a18b req-f5d8c8ad-586c-476e-a3b4-3bd85948f6ff service nova] Creating event network-vif-deleted:d44e75db-ffb2-4ea4-aa5f-60e34d9087e0 for instance 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce on hv-cinder-82160 Jan 17 02:36:50.047013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-3eaf5c47-6392-49a0-b31b-d175d789a18b req-f5d8c8ad-586c-476e-a3b4-3bd85948f6ff service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097820 Jan 17 02:36:50.048394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 224/443] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:50.105479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab457485fb6427ba5215ef491a03f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f3bbecadfb47dca935ac0986b088eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:50.114492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3840b9cc-3cea-45bf-b360-a64226f163b8 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 200 len: 1299 microversion: 2.1 time: 0.166910 Jan 17 02:36:50.115785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 220/444] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:49 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:50.137884 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:50.138575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:50.149736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.150313 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.151181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.151714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.251296 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:50.251920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:50.263605 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.264059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.264894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.265335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.339286 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:50.348581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5302b832-fa99-4ce4-96a5-4a56b674da8c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1509 microversion: 2.1 time: 0.215645 Jan 17 02:36:50.349710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 225/445] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:50 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:50.453188 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:50.453754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-09f8e35d-a0af-45b7-b35c-601057d7afdc tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1319 microversion: 2.1 time: 0.207136 Jan 17 02:36:50.454323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 221/446] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:50 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:50.544223 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-21bc124e-fd7a-4996-a5c5-9fb10fa77b4b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:50.545202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-21bc124e-fd7a-4996-a5c5-9fb10fa77b4b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:50.552267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21bc124e-fd7a-4996-a5c5-9fb10fa77b4b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.552711 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21bc124e-fd7a-4996-a5c5-9fb10fa77b4b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.553486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21bc124e-fd7a-4996-a5c5-9fb10fa77b4b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.553909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21bc124e-fd7a-4996-a5c5-9fb10fa77b4b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.585878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6bdd888b-5606-4561-a689-e09f709e5798 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:50.586895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6bdd888b-5606-4561-a689-e09f709e5798 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:50.597873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6bdd888b-5606-4561-a689-e09f709e5798 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.598319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6bdd888b-5606-4561-a689-e09f709e5798 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.599337 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6bdd888b-5606-4561-a689-e09f709e5798 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:50.599923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6bdd888b-5606-4561-a689-e09f709e5798 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:50.806847 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-21bc124e-fd7a-4996-a5c5-9fb10fa77b4b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.266290 Jan 17 02:36:50.809172 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 226/447] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:50 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:50.894141 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6bdd888b-5606-4561-a689-e09f709e5798 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.316259 Jan 17 02:36:50.894792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 222/448] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:50 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:51.132683 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:51.133395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] [instance: 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:51.143084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.143529 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.144369 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.144787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.162052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] HTTP exception thrown: Instance 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce could not be found. Jan 17 02:36:51.162656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] Returning 404 to user: Instance 8342f5e5-2a1a-491d-b1d4-d851e6e6fbce could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:51.163456 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3c22b0c2-13c9-4558-bd33-a2d1aae00e00 tempest-VolumesActionsTest-348529577 tempest-VolumesActionsTest-348529577-project] 10.222.0.24 "GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce" status: 404 len: 111 microversion: 2.1 time: 0.035167 Jan 17 02:36:51.164003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 227/449] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:51 2022] GET /compute/v2.1/servers/8342f5e5-2a1a-491d-b1d4-d851e6e6fbce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:36:51.366837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:51.367678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:51.374491 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.374943 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.375874 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.376535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.471851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:51.472496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:51.486906 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.487368 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.488221 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.489515 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.621872 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:51.629903 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-907fc91a-c584-4ae2-b53d-2425f7e0cf4d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1509 microversion: 2.1 time: 0.267407 Jan 17 02:36:51.633817 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 223/450] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:51 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:51.795809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:51.808791 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-669c2d10-840c-4402-8473-676baf283424 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1508 microversion: 2.1 time: 0.340943 Jan 17 02:36:51.810115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 228/451] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:51 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:51.820206 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-55cfba33-a3b7-4f20-9fc3-3dd4704e7991 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:51.821146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-55cfba33-a3b7-4f20-9fc3-3dd4704e7991 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:51.832816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55cfba33-a3b7-4f20-9fc3-3dd4704e7991 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.835687 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55cfba33-a3b7-4f20-9fc3-3dd4704e7991 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.839715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55cfba33-a3b7-4f20-9fc3-3dd4704e7991 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.841992 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55cfba33-a3b7-4f20-9fc3-3dd4704e7991 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.907312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b2ec1cf0-ed7b-47bc-b4a7-d517382a7c8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:51.908322 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b2ec1cf0-ed7b-47bc-b4a7-d517382a7c8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:51.914479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2ec1cf0-ed7b-47bc-b4a7-d517382a7c8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.917439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2ec1cf0-ed7b-47bc-b4a7-d517382a7c8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.918263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2ec1cf0-ed7b-47bc-b4a7-d517382a7c8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:51.918773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2ec1cf0-ed7b-47bc-b4a7-d517382a7c8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:51.971548 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-55cfba33-a3b7-4f20-9fc3-3dd4704e7991 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.156301 Jan 17 02:36:51.976217 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 224/452] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:51 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:52.050819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b2ec1cf0-ed7b-47bc-b4a7-d517382a7c8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.148093 Jan 17 02:36:52.056134 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 229/453] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:51 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:52.648721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:52.649399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:52.656671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:52.657288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:52.658248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:52.659298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:52.807284 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d79ac0cb-2cda-4dbc-a227-3a72161f7350"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:52.808565 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:52.816294 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:52.816731 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:52.817804 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:52.818445 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:52.906164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:52.915118 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ff26f280-ce73-4d1b-990d-130562b4bb59 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1509 microversion: 2.1 time: 0.270370 Jan 17 02:36:52.919393 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 225/454] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:52 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:52.940488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] HTTP exception thrown: Invalid volume: volume d79ac0cb-2cda-4dbc-a227-3a72161f7350 is already attached to instances: a8d204d6-b0f5-4ea5-932d-9cdbd447c999 Jan 17 02:36:52.941531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Returning 400 to user: Invalid volume: volume d79ac0cb-2cda-4dbc-a227-3a72161f7350 is already attached to instances: a8d204d6-b0f5-4ea5-932d-9cdbd447c999 {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:36:52.945420 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9077cdf1-7872-4b32-bec5-4a6981f26bdc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143461 Jan 17 02:36:52.947198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 230/455] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:36:52 2022] POST /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:36:52.983574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-95e1fcc6-2b64-426c-aa90-4f82c69feab1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:52.984575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-95e1fcc6-2b64-426c-aa90-4f82c69feab1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:52.998856 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95e1fcc6-2b64-426c-aa90-4f82c69feab1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:52.999728 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95e1fcc6-2b64-426c-aa90-4f82c69feab1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.001100 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95e1fcc6-2b64-426c-aa90-4f82c69feab1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.002158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95e1fcc6-2b64-426c-aa90-4f82c69feab1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.025599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:53.026181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:53.036363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.036877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.038254 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.038872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.118091 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-95e1fcc6-2b64-426c-aa90-4f82c69feab1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.138211 Jan 17 02:36:53.123181 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 226/456] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:52 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:53.139241 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ce1e61ab-27e7-40cf-8e16-373de612ebea tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:53.140666 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ce1e61ab-27e7-40cf-8e16-373de612ebea tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:53.163866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce1e61ab-27e7-40cf-8e16-373de612ebea tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.175379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce1e61ab-27e7-40cf-8e16-373de612ebea tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.179919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce1e61ab-27e7-40cf-8e16-373de612ebea tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.183723 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce1e61ab-27e7-40cf-8e16-373de612ebea tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.207879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lazy-loading 'services' on Instance uuid a8d204d6-b0f5-4ea5-932d-9cdbd447c999 {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:36:53.368774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b63bc395-a155-4a31-b6bb-f264dcf5dce8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments/d79ac0cb-2cda-4dbc-a227-3a72161f7350" status: 202 len: 0 microversion: 2.1 time: 0.350139 Jan 17 02:36:53.373540 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 231/457] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:36:53 2022] DELETE /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments/d79ac0cb-2cda-4dbc-a227-3a72161f7350 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:53.380877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c6075f3d-30ec-4f2d-93b6-9d4cb6ad8322 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:53.384158 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c6075f3d-30ec-4f2d-93b6-9d4cb6ad8322 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:53.392682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6075f3d-30ec-4f2d-93b6-9d4cb6ad8322 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.393274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6075f3d-30ec-4f2d-93b6-9d4cb6ad8322 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.394661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6075f3d-30ec-4f2d-93b6-9d4cb6ad8322 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.395416 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6075f3d-30ec-4f2d-93b6-9d4cb6ad8322 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.433750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c6075f3d-30ec-4f2d-93b6-9d4cb6ad8322 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058703 Jan 17 02:36:53.434687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 232/458] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:53 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:53.439632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ce1e61ab-27e7-40cf-8e16-373de612ebea tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.312688 Jan 17 02:36:53.441169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 227/459] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:53 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:53.937634 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:53.938862 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:53.948325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.949551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:53.950618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:53.951235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:54.133866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-06cdad8e-b877-4f45-b31c-7c472f037b3e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:54.135727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-06cdad8e-b877-4f45-b31c-7c472f037b3e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:54.145496 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06cdad8e-b877-4f45-b31c-7c472f037b3e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:54.147036 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06cdad8e-b877-4f45-b31c-7c472f037b3e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:54.148024 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06cdad8e-b877-4f45-b31c-7c472f037b3e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:54.148636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06cdad8e-b877-4f45-b31c-7c472f037b3e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:54.559990 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:36:54.568722 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4e876417-d6b6-4eaa-9994-3f3ae0c27c75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1515 microversion: 2.1 time: 0.636746 Jan 17 02:36:54.569345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 233/460] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:36:53 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1515 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:54.597075 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a95a5acc-9050-4546-b575-ee46776b2b4f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:54.601380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a95a5acc-9050-4546-b575-ee46776b2b4f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:54.618005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a95a5acc-9050-4546-b575-ee46776b2b4f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:54.618698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a95a5acc-9050-4546-b575-ee46776b2b4f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:54.619820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a95a5acc-9050-4546-b575-ee46776b2b4f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:54.620507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a95a5acc-9050-4546-b575-ee46776b2b4f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:54.697783 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a95a5acc-9050-4546-b575-ee46776b2b4f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114287 Jan 17 02:36:54.698359 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 234/461] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:54 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:54.703468 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-df24f849-6fe7-4ac7-ba3b-6fbc59282873 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:54.704781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-df24f849-6fe7-4ac7-ba3b-6fbc59282873 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:54.719708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df24f849-6fe7-4ac7-ba3b-6fbc59282873 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:54.720210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df24f849-6fe7-4ac7-ba3b-6fbc59282873 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:54.721320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df24f849-6fe7-4ac7-ba3b-6fbc59282873 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:54.721767 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df24f849-6fe7-4ac7-ba3b-6fbc59282873 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:58.151308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-06cdad8e-b877-4f45-b31c-7c472f037b3e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 4.023865 Jan 17 02:36:58.155489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 228/462] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:54 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 4027 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:36:58.158093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-391fc054-73ae-4508-a6dc-dc37ad373ac1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:58.159438 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-391fc054-73ae-4508-a6dc-dc37ad373ac1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:58.167451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-391fc054-73ae-4508-a6dc-dc37ad373ac1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:58.167928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-391fc054-73ae-4508-a6dc-dc37ad373ac1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:58.168807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-391fc054-73ae-4508-a6dc-dc37ad373ac1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:58.169694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-391fc054-73ae-4508-a6dc-dc37ad373ac1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:58.174115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-df24f849-6fe7-4ac7-ba3b-6fbc59282873 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 3.473469 Jan 17 02:36:58.178100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 235/463] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:54 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 3476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:58.204154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-391fc054-73ae-4508-a6dc-dc37ad373ac1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049824 Jan 17 02:36:58.204730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 229/464] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:58 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:36:58.362379 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-73b71cf3-c269-4232-98bd-1e46cb52f65d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Action: 'create', calling method: .version_select at 0x7f074e617820>, body: {"keypair": {"name": "tempest-TestShelveInstance-323961130"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:58.380132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-73b71cf3-c269-4232-98bd-1e46cb52f65d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Getting quotas for project 0dec6844a62b4685a182219dbf9bea72. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:36:58.384490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-73b71cf3-c269-4232-98bd-1e46cb52f65d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Getting quotas for user 3066aac319784300b9d8f0c1c8f298ca and project 0dec6844a62b4685a182219dbf9bea72. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:36:58.556718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-73b71cf3-c269-4232-98bd-1e46cb52f65d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Getting quotas for project 0dec6844a62b4685a182219dbf9bea72. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:36:58.560315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-73b71cf3-c269-4232-98bd-1e46cb52f65d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Getting quotas for user 3066aac319784300b9d8f0c1c8f298ca and project 0dec6844a62b4685a182219dbf9bea72. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:36:58.573792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-73b71cf3-c269-4232-98bd-1e46cb52f65d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.396793 Jan 17 02:36:58.574475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 236/465] 10.222.0.24 () {60 vars in 1157 bytes} [Mon Jan 17 02:36:58 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:36:59.163407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7ce4ecb7-0b0f-495c-8e1b-79a7255f0f42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:59.164364 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7ce4ecb7-0b0f-495c-8e1b-79a7255f0f42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:59.171977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ce4ecb7-0b0f-495c-8e1b-79a7255f0f42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:59.172542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ce4ecb7-0b0f-495c-8e1b-79a7255f0f42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:59.173498 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ce4ecb7-0b0f-495c-8e1b-79a7255f0f42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:59.173967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ce4ecb7-0b0f-495c-8e1b-79a7255f0f42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:59.191548 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0fab372c-495c-4b70-b736-63a23bc0fc10 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:36:59.193167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0fab372c-495c-4b70-b736-63a23bc0fc10 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:59.202477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fab372c-495c-4b70-b736-63a23bc0fc10 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:59.202931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fab372c-495c-4b70-b736-63a23bc0fc10 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:59.203897 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fab372c-495c-4b70-b736-63a23bc0fc10 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:59.204362 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fab372c-495c-4b70-b736-63a23bc0fc10 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:59.315630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7ce4ecb7-0b0f-495c-8e1b-79a7255f0f42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.155720 Jan 17 02:36:59.317169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 230/466] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:36:59 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:36:59.324307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8383ead9-fedf-40d4-9eec-a7c448130eda tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:36:59.326450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8383ead9-fedf-40d4-9eec-a7c448130eda tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:36:59.338076 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8383ead9-fedf-40d4-9eec-a7c448130eda tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:59.338526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8383ead9-fedf-40d4-9eec-a7c448130eda tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:59.339373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8383ead9-fedf-40d4-9eec-a7c448130eda tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:36:59.339820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8383ead9-fedf-40d4-9eec-a7c448130eda tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:36:59.349968 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0fab372c-495c-4b70-b736-63a23bc0fc10 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.162698 Jan 17 02:36:59.354140 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 237/467] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:36:59 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:36:59.399815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8383ead9-fedf-40d4-9eec-a7c448130eda tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081202 Jan 17 02:36:59.400415 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 231/468] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:36:59 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:37:00.336267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a76832c9-ecf5-4c2d-be74-9faee8b2a80c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:00.336996 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a76832c9-ecf5-4c2d-be74-9faee8b2a80c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:00.351519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a76832c9-ecf5-4c2d-be74-9faee8b2a80c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.351946 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a76832c9-ecf5-4c2d-be74-9faee8b2a80c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.353793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a76832c9-ecf5-4c2d-be74-9faee8b2a80c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.357102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a76832c9-ecf5-4c2d-be74-9faee8b2a80c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.364720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6864c94f-43dc-4c4e-9096-eb30eab4c37b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:00.366989 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6864c94f-43dc-4c4e-9096-eb30eab4c37b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:00.378293 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6864c94f-43dc-4c4e-9096-eb30eab4c37b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.379007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6864c94f-43dc-4c4e-9096-eb30eab4c37b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.390138 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6864c94f-43dc-4c4e-9096-eb30eab4c37b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.390885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6864c94f-43dc-4c4e-9096-eb30eab4c37b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.538312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a76832c9-ecf5-4c2d-be74-9faee8b2a80c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.212093 Jan 17 02:37:00.539373 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 238/469] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:00 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:00.547506 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4f50c458-2ebc-4e75-b0a0-f015dc8d6314 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:00.549220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4f50c458-2ebc-4e75-b0a0-f015dc8d6314 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:00.561206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f50c458-2ebc-4e75-b0a0-f015dc8d6314 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.561646 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f50c458-2ebc-4e75-b0a0-f015dc8d6314 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.561796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6864c94f-43dc-4c4e-9096-eb30eab4c37b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.203123 Jan 17 02:37:00.562422 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 232/470] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:00 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:00.563067 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f50c458-2ebc-4e75-b0a0-f015dc8d6314 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.563770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f50c458-2ebc-4e75-b0a0-f015dc8d6314 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.569493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:00.570182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:00.576981 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.577443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.578235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.578673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.596962 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4f50c458-2ebc-4e75-b0a0-f015dc8d6314 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056193 Jan 17 02:37:00.597522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 239/471] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:37:00 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:37:00.741767 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:00.750116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4fe48d06-1ed2-49a4-a763-1dd43fd386de tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1515 microversion: 2.1 time: 0.186210 Jan 17 02:37:00.750697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 233/472] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:00 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:00.776423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-43aee9e5-a73d-4256-be76-bfa572e6a15b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d81be3-6697-4308-b766-23dd5107a0c3"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:00.778215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-43aee9e5-a73d-4256-be76-bfa572e6a15b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:00.782779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-288291524", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "97da4c82-5c36-47e9-8cea-2b4c9d79a703"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:00.786248 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43aee9e5-a73d-4256-be76-bfa572e6a15b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.786816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43aee9e5-a73d-4256-be76-bfa572e6a15b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:00.787651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43aee9e5-a73d-4256-be76-bfa572e6a15b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:00.788219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43aee9e5-a73d-4256-be76-bfa572e6a15b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:01.168732 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-43aee9e5-a73d-4256-be76-bfa572e6a15b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405306 Jan 17 02:37:01.169796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 240/473] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:37:00 2022] POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:37:01.551821 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ea6d5421-a26b-4c92-b714-a2ec68347229 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:01.552952 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ea6d5421-a26b-4c92-b714-a2ec68347229 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:01.559100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea6d5421-a26b-4c92-b714-a2ec68347229 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:01.559641 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea6d5421-a26b-4c92-b714-a2ec68347229 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:01.560534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea6d5421-a26b-4c92-b714-a2ec68347229 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:01.561034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea6d5421-a26b-4c92-b714-a2ec68347229 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:01.693182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ea6d5421-a26b-4c92-b714-a2ec68347229 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.145669 Jan 17 02:37:01.694574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 241/474] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:01 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:01.701477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-49875524-29eb-47f3-879a-bcd476fbec80 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:01.705472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-49875524-29eb-47f3-879a-bcd476fbec80 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:01.713652 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49875524-29eb-47f3-879a-bcd476fbec80 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:01.714455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49875524-29eb-47f3-879a-bcd476fbec80 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:01.715651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49875524-29eb-47f3-879a-bcd476fbec80 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:01.716093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49875524-29eb-47f3-879a-bcd476fbec80 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:01.855429 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-49875524-29eb-47f3-879a-bcd476fbec80 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.159034 Jan 17 02:37:01.856340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 242/475] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:01 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:02.705936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-82d09903-fc4a-42b1-837c-534f10f5d36e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:02.707966 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-82d09903-fc4a-42b1-837c-534f10f5d36e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:02.715573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82d09903-fc4a-42b1-837c-534f10f5d36e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:02.716439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82d09903-fc4a-42b1-837c-534f10f5d36e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:02.717468 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82d09903-fc4a-42b1-837c-534f10f5d36e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:02.717966 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82d09903-fc4a-42b1-837c-534f10f5d36e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:02.833376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-82d09903-fc4a-42b1-837c-534f10f5d36e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.131351 Jan 17 02:37:02.834936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 243/476] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:02 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:02.867813 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-933a1da2-f22f-4dbc-932d-cf5903253e04 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:02.868851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-933a1da2-f22f-4dbc-932d-cf5903253e04 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:02.877676 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-933a1da2-f22f-4dbc-932d-cf5903253e04 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:02.878485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-933a1da2-f22f-4dbc-932d-cf5903253e04 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:02.879549 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-933a1da2-f22f-4dbc-932d-cf5903253e04 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:02.880241 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-933a1da2-f22f-4dbc-932d-cf5903253e04 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:03.005844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-933a1da2-f22f-4dbc-932d-cf5903253e04 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.141541 Jan 17 02:37:03.008119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 244/477] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:02 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:03.847167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-90a1044d-ffbe-4be2-b701-ad957e860e51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:03.848996 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-90a1044d-ffbe-4be2-b701-ad957e860e51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:03.865404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90a1044d-ffbe-4be2-b701-ad957e860e51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:03.866084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90a1044d-ffbe-4be2-b701-ad957e860e51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:03.867547 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90a1044d-ffbe-4be2-b701-ad957e860e51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:03.868191 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90a1044d-ffbe-4be2-b701-ad957e860e51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:03.997663 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-90a1044d-ffbe-4be2-b701-ad957e860e51 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.147997 Jan 17 02:37:03.998534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 245/478] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:03 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:04.019479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8270fea4-71ca-49d8-a37e-b89ec06f5bd0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:04.020875 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8270fea4-71ca-49d8-a37e-b89ec06f5bd0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:04.028778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8270fea4-71ca-49d8-a37e-b89ec06f5bd0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:04.029566 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8270fea4-71ca-49d8-a37e-b89ec06f5bd0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:04.030614 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8270fea4-71ca-49d8-a37e-b89ec06f5bd0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:04.031592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8270fea4-71ca-49d8-a37e-b89ec06f5bd0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:04.143258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8270fea4-71ca-49d8-a37e-b89ec06f5bd0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.128317 Jan 17 02:37:04.144135 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 246/479] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:04 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:05.018020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2f922dc9-9955-4dc1-9e71-edfc6b4493cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:05.019145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2f922dc9-9955-4dc1-9e71-edfc6b4493cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:05.026879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f922dc9-9955-4dc1-9e71-edfc6b4493cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:05.027755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f922dc9-9955-4dc1-9e71-edfc6b4493cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:05.029080 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f922dc9-9955-4dc1-9e71-edfc6b4493cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:05.029763 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f922dc9-9955-4dc1-9e71-edfc6b4493cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:05.150539 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2f922dc9-9955-4dc1-9e71-edfc6b4493cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.136414 Jan 17 02:37:05.151185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 247/480] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:05 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:05.157445 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-df62fcf9-f398-43de-8ba8-ea3e2d795f6f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:05.158862 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-df62fcf9-f398-43de-8ba8-ea3e2d795f6f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:05.166677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df62fcf9-f398-43de-8ba8-ea3e2d795f6f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:05.167113 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df62fcf9-f398-43de-8ba8-ea3e2d795f6f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:05.168097 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df62fcf9-f398-43de-8ba8-ea3e2d795f6f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:05.168588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-df62fcf9-f398-43de-8ba8-ea3e2d795f6f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:05.299015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-df62fcf9-f398-43de-8ba8-ea3e2d795f6f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.146165 Jan 17 02:37:05.300383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 248/481] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:05 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:06.163311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4290d972-b9ea-4340-a2bf-c5a535feb95d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:06.164348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4290d972-b9ea-4340-a2bf-c5a535feb95d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:06.173757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4290d972-b9ea-4340-a2bf-c5a535feb95d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:06.174208 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4290d972-b9ea-4340-a2bf-c5a535feb95d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:06.175003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4290d972-b9ea-4340-a2bf-c5a535feb95d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:06.175460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4290d972-b9ea-4340-a2bf-c5a535feb95d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:06.312682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4290d972-b9ea-4340-a2bf-c5a535feb95d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.153153 Jan 17 02:37:06.316860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 249/482] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:06 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:06.322421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-43ea314d-7fc6-4114-bb52-056dca4fa61d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:06.323656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-43ea314d-7fc6-4114-bb52-056dca4fa61d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:06.331237 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43ea314d-7fc6-4114-bb52-056dca4fa61d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:06.331877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43ea314d-7fc6-4114-bb52-056dca4fa61d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:06.332702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43ea314d-7fc6-4114-bb52-056dca4fa61d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:06.333280 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-43ea314d-7fc6-4114-bb52-056dca4fa61d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:06.469422 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-43ea314d-7fc6-4114-bb52-056dca4fa61d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.150843 Jan 17 02:37:06.470105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 250/483] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:06 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:07.325857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-95bde02d-387c-4588-8bda-3ca9179a4a07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:07.327859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-95bde02d-387c-4588-8bda-3ca9179a4a07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:07.336165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95bde02d-387c-4588-8bda-3ca9179a4a07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:07.336926 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95bde02d-387c-4588-8bda-3ca9179a4a07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:07.337735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95bde02d-387c-4588-8bda-3ca9179a4a07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:07.338133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95bde02d-387c-4588-8bda-3ca9179a4a07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:07.513275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-95bde02d-387c-4588-8bda-3ca9179a4a07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.191530 Jan 17 02:37:07.518537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 251/484] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:07 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:07.524819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c9188016-d78d-4c60-92c3-cafa61172d73 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:07.525904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c9188016-d78d-4c60-92c3-cafa61172d73 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:07.534708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9188016-d78d-4c60-92c3-cafa61172d73 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:07.535553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9188016-d78d-4c60-92c3-cafa61172d73 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:07.536443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9188016-d78d-4c60-92c3-cafa61172d73 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:07.536966 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9188016-d78d-4c60-92c3-cafa61172d73 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:07.661044 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c9188016-d78d-4c60-92c3-cafa61172d73 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.140558 Jan 17 02:37:07.661713 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 252/485] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:07 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:08.525766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4ceb5add-d33b-4fad-a04e-00646a83bc46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:08.526739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4ceb5add-d33b-4fad-a04e-00646a83bc46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:08.534254 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4ceb5add-d33b-4fad-a04e-00646a83bc46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:08.534913 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4ceb5add-d33b-4fad-a04e-00646a83bc46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:08.535739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4ceb5add-d33b-4fad-a04e-00646a83bc46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:08.536218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4ceb5add-d33b-4fad-a04e-00646a83bc46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:08.658045 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4ceb5add-d33b-4fad-a04e-00646a83bc46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.135945 Jan 17 02:37:08.659479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 253/486] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:08 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:08.683156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ccd94ebc-5bd6-4346-94a6-77181f6bd0ad tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:08.684974 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ccd94ebc-5bd6-4346-94a6-77181f6bd0ad tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:08.692104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccd94ebc-5bd6-4346-94a6-77181f6bd0ad tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:08.692508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccd94ebc-5bd6-4346-94a6-77181f6bd0ad tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:08.693287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccd94ebc-5bd6-4346-94a6-77181f6bd0ad tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:08.693720 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccd94ebc-5bd6-4346-94a6-77181f6bd0ad tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:08.832755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ccd94ebc-5bd6-4346-94a6-77181f6bd0ad tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.163477 Jan 17 02:37:08.834775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 254/487] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:08 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:09.672410 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4b5035b5-9944-45ba-9962-07531c0b1df0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:09.673443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4b5035b5-9944-45ba-9962-07531c0b1df0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:09.684034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b5035b5-9944-45ba-9962-07531c0b1df0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:09.684768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b5035b5-9944-45ba-9962-07531c0b1df0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:09.685574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b5035b5-9944-45ba-9962-07531c0b1df0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:09.686007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b5035b5-9944-45ba-9962-07531c0b1df0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:09.791714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4b5035b5-9944-45ba-9962-07531c0b1df0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.123404 Jan 17 02:37:09.792496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 255/488] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:09 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:09.818940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:09.821182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:09.832633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:09.833744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:09.835061 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:09.835970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:09.868677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lazy-loading 'flavor' on Instance uuid 24ef95ec-9461-446c-ac23-d29814c0a4fa {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:37:10.058749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-613db6e0-ab4a-49f6-9b07-7070c455d5b7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action" status: 200 len: 32 microversion: 2.1 time: 0.247665 Jan 17 02:37:10.063519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 256/489] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:09 2022] POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:37:10.068945 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-199308ab-f620-493a-af89-a45206d431a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:10.070185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-199308ab-f620-493a-af89-a45206d431a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:10.084882 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-199308ab-f620-493a-af89-a45206d431a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:10.085612 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-199308ab-f620-493a-af89-a45206d431a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:10.086784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-199308ab-f620-493a-af89-a45206d431a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:10.087383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-199308ab-f620-493a-af89-a45206d431a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:10.252425 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-199308ab-f620-493a-af89-a45206d431a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.187166 Jan 17 02:37:10.256653 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 257/490] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:10 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:10.262063 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:10.263071 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:10.270231 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:10.271001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:10.272058 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:10.272713 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:10.599792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:10.608176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-53e6369e-48a7-4ba7-b614-97060d5577ff tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.349940 Jan 17 02:37:10.617745 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 258/491] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:10 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:10.812315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e26513d9-5935-4b70-859f-d42bae5fce4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:10.814264 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e26513d9-5935-4b70-859f-d42bae5fce4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:10.826224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e26513d9-5935-4b70-859f-d42bae5fce4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:10.827043 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e26513d9-5935-4b70-859f-d42bae5fce4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:10.828232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e26513d9-5935-4b70-859f-d42bae5fce4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:10.828920 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e26513d9-5935-4b70-859f-d42bae5fce4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:10.995727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e26513d9-5935-4b70-859f-d42bae5fce4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.194866 Jan 17 02:37:10.997061 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 259/492] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:10 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:11.266932 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f1153dec-6281-435e-8ae3-2db7a08dae17 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:11.268468 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f1153dec-6281-435e-8ae3-2db7a08dae17 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:11.277534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1153dec-6281-435e-8ae3-2db7a08dae17 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:11.278771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1153dec-6281-435e-8ae3-2db7a08dae17 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:11.279817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1153dec-6281-435e-8ae3-2db7a08dae17 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:11.280619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1153dec-6281-435e-8ae3-2db7a08dae17 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:11.413129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f1153dec-6281-435e-8ae3-2db7a08dae17 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.151671 Jan 17 02:37:11.418467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 260/493] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:11 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:11.628395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:11.632984 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:11.646602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:11.647670 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:11.649615 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:11.650371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:11.818689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:11.826842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d4afe9cc-5eb8-4094-b44c-497ea6ba4d06 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.204825 Jan 17 02:37:11.827594 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 261/494] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:11 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:12.008377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3c58af9c-40b2-434f-a42d-711ed8e35148 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:12.009395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3c58af9c-40b2-434f-a42d-711ed8e35148 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:12.016574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c58af9c-40b2-434f-a42d-711ed8e35148 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:12.017101 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c58af9c-40b2-434f-a42d-711ed8e35148 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:12.017992 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c58af9c-40b2-434f-a42d-711ed8e35148 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:12.018526 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3c58af9c-40b2-434f-a42d-711ed8e35148 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:12.146597 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3c58af9c-40b2-434f-a42d-711ed8e35148 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.141725 Jan 17 02:37:12.157193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 262/495] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:12 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:12.427532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9b5b12d1-faa1-40ca-a7a7-ed7fbf61adc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:12.428825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9b5b12d1-faa1-40ca-a7a7-ed7fbf61adc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:12.437142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b5b12d1-faa1-40ca-a7a7-ed7fbf61adc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:12.437695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b5b12d1-faa1-40ca-a7a7-ed7fbf61adc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:12.438845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b5b12d1-faa1-40ca-a7a7-ed7fbf61adc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:12.439477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b5b12d1-faa1-40ca-a7a7-ed7fbf61adc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:12.572391 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9b5b12d1-faa1-40ca-a7a7-ed7fbf61adc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.143495 Jan 17 02:37:12.573156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 263/496] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:12 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:12.848844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:12.850493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:12.869116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:12.870239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:12.871271 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:12.872026 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:13.035478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:13.047761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d79bd70c-6c7a-41de-ae14-0817f7006e70 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.203695 Jan 17 02:37:13.048372 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 264/497] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:12 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:13.160424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fa4bffdf-9f24-4b64-8d9f-1f533951d7e4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:13.162244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fa4bffdf-9f24-4b64-8d9f-1f533951d7e4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:13.169303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa4bffdf-9f24-4b64-8d9f-1f533951d7e4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:13.169990 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa4bffdf-9f24-4b64-8d9f-1f533951d7e4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:13.171062 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa4bffdf-9f24-4b64-8d9f-1f533951d7e4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:13.171716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa4bffdf-9f24-4b64-8d9f-1f533951d7e4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:13.307485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fa4bffdf-9f24-4b64-8d9f-1f533951d7e4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.152194 Jan 17 02:37:13.308158 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 265/498] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:13 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:13.586347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7b752b83-ed12-42a0-8ec4-ff5bcfbe6d95 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:13.587598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7b752b83-ed12-42a0-8ec4-ff5bcfbe6d95 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:13.604367 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b752b83-ed12-42a0-8ec4-ff5bcfbe6d95 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:13.605105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b752b83-ed12-42a0-8ec4-ff5bcfbe6d95 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:13.606352 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b752b83-ed12-42a0-8ec4-ff5bcfbe6d95 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:13.606873 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b752b83-ed12-42a0-8ec4-ff5bcfbe6d95 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:13.713816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7b752b83-ed12-42a0-8ec4-ff5bcfbe6d95 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.132679 Jan 17 02:37:13.715216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 266/499] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:13 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:14.066067 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:14.066759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:14.073717 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:14.074633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:14.075778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:14.076401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:14.252921 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:14.260998 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-372a5106-cb9e-465d-8321-d513b24bd91d tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.199584 Jan 17 02:37:14.261557 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 267/500] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:14 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:14.321398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-18809383-a58d-4d83-b43d-edb7d31b110b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:14.322550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-18809383-a58d-4d83-b43d-edb7d31b110b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:14.329544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18809383-a58d-4d83-b43d-edb7d31b110b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:14.330015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18809383-a58d-4d83-b43d-edb7d31b110b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:14.330837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18809383-a58d-4d83-b43d-edb7d31b110b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:14.331299 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18809383-a58d-4d83-b43d-edb7d31b110b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:14.479947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-18809383-a58d-4d83-b43d-edb7d31b110b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.163691 Jan 17 02:37:14.481027 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 268/501] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:14 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:14.727378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e068ff42-3e86-4bd1-a1b7-78f531c5d82d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:14.728486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e068ff42-3e86-4bd1-a1b7-78f531c5d82d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:14.736488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e068ff42-3e86-4bd1-a1b7-78f531c5d82d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:14.736956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e068ff42-3e86-4bd1-a1b7-78f531c5d82d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:14.738026 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e068ff42-3e86-4bd1-a1b7-78f531c5d82d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:14.738505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e068ff42-3e86-4bd1-a1b7-78f531c5d82d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:14.869303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e068ff42-3e86-4bd1-a1b7-78f531c5d82d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.146147 Jan 17 02:37:14.870457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 269/502] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:14 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:15.277960 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:15.278657 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:15.286060 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:15.286516 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:15.287295 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:15.287734 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:15.443419 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:15.453302 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0cc62650-e504-4a32-81c8-9ed67fdd922e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.179214 Jan 17 02:37:15.454480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 270/503] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:15 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:15.494502 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-238de833-725e-43c7-8a80-eeff916b475d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:15.495660 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-238de833-725e-43c7-8a80-eeff916b475d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:15.502523 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-238de833-725e-43c7-8a80-eeff916b475d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:15.503338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-238de833-725e-43c7-8a80-eeff916b475d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:15.504363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-238de833-725e-43c7-8a80-eeff916b475d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:15.505324 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-238de833-725e-43c7-8a80-eeff916b475d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:15.609273 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-238de833-725e-43c7-8a80-eeff916b475d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.118620 Jan 17 02:37:15.613016 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 271/504] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:15 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:15.890593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0f463518-93ff-4ac3-aec1-5d2c490d0624 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:15.890593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0f463518-93ff-4ac3-aec1-5d2c490d0624 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:15.898233 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0f463518-93ff-4ac3-aec1-5d2c490d0624 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:15.898683 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0f463518-93ff-4ac3-aec1-5d2c490d0624 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:15.899621 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0f463518-93ff-4ac3-aec1-5d2c490d0624 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:15.900130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0f463518-93ff-4ac3-aec1-5d2c490d0624 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:16.037193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0f463518-93ff-4ac3-aec1-5d2c490d0624 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.158392 Jan 17 02:37:16.037834 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 272/505] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:15 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:16.472012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:16.472829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:16.480859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:16.481324 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:16.482354 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:16.483039 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:16.634441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:16.644586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0a3388d8-7ad1-49ce-964a-389d653fbd53 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.177825 Jan 17 02:37:16.645160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 273/506] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:16 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:16.658340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1253f58d-65ee-4c57-94e3-1665977c64d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:16.659345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1253f58d-65ee-4c57-94e3-1665977c64d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:16.666021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1253f58d-65ee-4c57-94e3-1665977c64d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:16.666575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1253f58d-65ee-4c57-94e3-1665977c64d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:16.667371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1253f58d-65ee-4c57-94e3-1665977c64d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:16.667994 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1253f58d-65ee-4c57-94e3-1665977c64d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:16.797965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1253f58d-65ee-4c57-94e3-1665977c64d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.150826 Jan 17 02:37:16.799011 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 274/507] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:16 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:17.007651 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] validate_networks() for [('97da4c82-5c36-47e9-8cea-2b4c9d79a703', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:37:17.049975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-42701d11-e71d-470e-a99f-3c36bc0d4797 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:17.051014 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-42701d11-e71d-470e-a99f-3c36bc0d4797 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:17.057949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42701d11-e71d-470e-a99f-3c36bc0d4797 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.058473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42701d11-e71d-470e-a99f-3c36bc0d4797 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:17.059324 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42701d11-e71d-470e-a99f-3c36bc0d4797 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.059844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42701d11-e71d-470e-a99f-3c36bc0d4797 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:17.385511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:37:17.385935 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:37:17.386405 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:37:17.386811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:37:17.387262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:37:17.396153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.396605 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:17.397421 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.397855 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:17.415610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:37:17.420026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Getting quotas for user d19dac2ccdf34b62bf4dc5b43c034648 and project c889c4e9bfb24231968d2c8e2d02a1b2. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:37:17.431667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:37:17.434025 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:37:17.479770 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bc59f0b5-9895-466a-8ba6-74e0a9302bd1 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.700802 Jan 17 02:37:17.480655 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 234/508] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 16702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:37:17.490295 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-138f6f8a-68f3-42ed-85be-e56af28dce69 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:17.490911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-138f6f8a-68f3-42ed-85be-e56af28dce69 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:17.546312 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-138f6f8a-68f3-42ed-85be-e56af28dce69 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:17.552805 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-138f6f8a-68f3-42ed-85be-e56af28dce69 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1217 microversion: 2.1 time: 0.066159 Jan 17 02:37:17.553620 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 235/509] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:17 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:17.662230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:17.662854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:17.669306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.669750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:17.670533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.670967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:17.802678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:17.811117 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4db106d1-74b0-473c-9ff2-0c15f8567f2c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.153195 Jan 17 02:37:17.811688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 236/510] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:17 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:17.816377 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-664c11fb-2a66-4f15-89ff-15fea357bd94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:17.817714 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-664c11fb-2a66-4f15-89ff-15fea357bd94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:17.823931 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-664c11fb-2a66-4f15-89ff-15fea357bd94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.824419 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-664c11fb-2a66-4f15-89ff-15fea357bd94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:17.825360 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-664c11fb-2a66-4f15-89ff-15fea357bd94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:17.826009 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-664c11fb-2a66-4f15-89ff-15fea357bd94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:22.245732 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-42701d11-e71d-470e-a99f-3c36bc0d4797 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 5.199612 Jan 17 02:37:22.248683 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 275/511] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:17 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 5204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:22.256660 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:22.257691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:22.265270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:22.266235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:22.268233 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:22.268859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:22.314019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-664c11fb-2a66-4f15-89ff-15fea357bd94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 4.500814 Jan 17 02:37:22.318615 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 237/512] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:17 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 4503 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:22.321296 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:22.322049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:22.336809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:22.337379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:22.338610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:22.339057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:22.347742 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:22.360575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1fc988ef-fdea-4bc8-84d5-0a0fe5954e92 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1221 microversion: 2.1 time: 0.110259 Jan 17 02:37:22.362028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 276/513] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:22 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:22.503761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:22.512442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-daae0d80-5b0b-4ef9-b474-6cc3e12d250e tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.196015 Jan 17 02:37:22.513019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 238/514] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:22 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:23.258927 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-17a5f12c-a290-45f0-8893-02c0a7a03bda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:23.259836 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-17a5f12c-a290-45f0-8893-02c0a7a03bda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:23.266783 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17a5f12c-a290-45f0-8893-02c0a7a03bda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.267232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17a5f12c-a290-45f0-8893-02c0a7a03bda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.267996 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17a5f12c-a290-45f0-8893-02c0a7a03bda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.268462 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17a5f12c-a290-45f0-8893-02c0a7a03bda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.326314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cbc278af-f150-4272-a004-ea4974532b5f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:23.327242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cbc278af-f150-4272-a004-ea4974532b5f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:23.334481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbc278af-f150-4272-a004-ea4974532b5f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.334933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbc278af-f150-4272-a004-ea4974532b5f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.335732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbc278af-f150-4272-a004-ea4974532b5f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.336199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbc278af-f150-4272-a004-ea4974532b5f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.367307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-17a5f12c-a290-45f0-8893-02c0a7a03bda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.111891 Jan 17 02:37:23.371328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 277/515] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:23 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:23.377312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:23.377993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:23.385398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.385842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.386656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.387089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.444731 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cbc278af-f150-4272-a004-ea4974532b5f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.121778 Jan 17 02:37:23.445478 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 239/516] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:23 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:23.453351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:23.462603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b0e0f632-8c6c-4e29-ad8e-8fb16f78f537 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1269 microversion: 2.1 time: 0.089394 Jan 17 02:37:23.463926 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 278/517] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:23 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:23.532181 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:23.533367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:23.543253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.543839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.545026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:23.545470 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:23.885260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:23.899769 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ca2964b6-f574-44d2-8f38-ded8ef00db97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.372999 Jan 17 02:37:23.900635 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 240/518] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:23 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:24.379908 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-55170679-266f-4752-b033-23a6aa73deda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:24.381186 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-55170679-266f-4752-b033-23a6aa73deda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:24.392141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55170679-266f-4752-b033-23a6aa73deda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:24.393386 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55170679-266f-4752-b033-23a6aa73deda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:24.394589 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55170679-266f-4752-b033-23a6aa73deda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:24.395503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55170679-266f-4752-b033-23a6aa73deda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:24.458223 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f8354911-cb62-4b05-8e1e-65de097bbe2b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:24.460095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f8354911-cb62-4b05-8e1e-65de097bbe2b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:24.467350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f8354911-cb62-4b05-8e1e-65de097bbe2b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:24.468038 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f8354911-cb62-4b05-8e1e-65de097bbe2b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:24.469317 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f8354911-cb62-4b05-8e1e-65de097bbe2b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:24.469926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f8354911-cb62-4b05-8e1e-65de097bbe2b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:30.658655 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-55170679-266f-4752-b033-23a6aa73deda tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 6.282264 Jan 17 02:37:30.660497 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 279/519] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:24 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 6285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:30.665465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:30.666190 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:30.674308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:30.675093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:30.676445 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:30.678548 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:30.714900 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f8354911-cb62-4b05-8e1e-65de097bbe2b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 6.260532 Jan 17 02:37:30.719463 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 241/520] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:24 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 6266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:30.724711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:30.725707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:30.733119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:30.733560 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:30.734593 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:30.735031 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:31.046722 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:31.052781 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:31.056151 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5645021f-4c5b-4635-bb8d-8feeef1f24e6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.394432 Jan 17 02:37:31.056917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 280/521] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:30 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:31.070339 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9047cf12-7d74-4bca-826f-067babf15c37 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.349424 Jan 17 02:37:31.071082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 242/522] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:30 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:31.422904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-0a4e7f9f-3067-44b1-8636-69534ff2e4f2 req-df2f3f71-755d-4c21-891e-1e5016a64644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9b84647-19b2-4847-a95c-7fcff9ab436a", "tag": "0ee354e1-38b7-4917-b74d-ad4c255e5515"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:31.424603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:37:31.424603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:37:31.432714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-0a4e7f9f-3067-44b1-8636-69534ff2e4f2 req-df2f3f71-755d-4c21-891e-1e5016a64644 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:31.433234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-0a4e7f9f-3067-44b1-8636-69534ff2e4f2 req-df2f3f71-755d-4c21-891e-1e5016a64644 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:31.443424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-0a4e7f9f-3067-44b1-8636-69534ff2e4f2 req-df2f3f71-755d-4c21-891e-1e5016a64644 service nova] Creating event network-changed:0ee354e1-38b7-4917-b74d-ad4c255e5515 for instance f9b84647-19b2-4847-a95c-7fcff9ab436a on hv-cinder-82160 Jan 17 02:37:31.448519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-0a4e7f9f-3067-44b1-8636-69534ff2e4f2 req-df2f3f71-755d-4c21-891e-1e5016a64644 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029359 Jan 17 02:37:31.449109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 281/523] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:37:31.671333 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1572e4ca-7a34-4cdd-9422-228026839d75 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:31.672662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1572e4ca-7a34-4cdd-9422-228026839d75 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:31.683214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1572e4ca-7a34-4cdd-9422-228026839d75 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:31.684121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1572e4ca-7a34-4cdd-9422-228026839d75 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:31.685178 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1572e4ca-7a34-4cdd-9422-228026839d75 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:31.685895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1572e4ca-7a34-4cdd-9422-228026839d75 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:31.727716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-754c3331-23f9-49aa-b162-9052b95ed934 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:31.728777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-754c3331-23f9-49aa-b162-9052b95ed934 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:31.735079 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-754c3331-23f9-49aa-b162-9052b95ed934 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:31.735501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-754c3331-23f9-49aa-b162-9052b95ed934 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:31.736306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-754c3331-23f9-49aa-b162-9052b95ed934 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:31.736897 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-754c3331-23f9-49aa-b162-9052b95ed934 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:31.907349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1572e4ca-7a34-4cdd-9422-228026839d75 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.240489 Jan 17 02:37:31.908350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 243/524] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:31 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:31.950515 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-754c3331-23f9-49aa-b162-9052b95ed934 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.226953 Jan 17 02:37:31.951453 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 282/525] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:31 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:32.076949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:32.077645 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:32.084901 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.085354 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:32.086136 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.086550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:32.088752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:32.089381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:32.096682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.097368 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:32.099551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.099551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:32.295042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:32.303059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-da47f9f1-dd8c-4f9c-a3ec-5fff672f9f51 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.230277 Jan 17 02:37:32.303710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 244/526] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:32 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:32.321427 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:32.329355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-63c691b9-6804-4cb7-a350-fdfe2c085119 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.244988 Jan 17 02:37:32.329920 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 283/527] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:32 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:32.919275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2548c5f5-bc1f-425c-a91b-0a4ed79c8f4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:32.920597 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2548c5f5-bc1f-425c-a91b-0a4ed79c8f4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:32.926767 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2548c5f5-bc1f-425c-a91b-0a4ed79c8f4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.927211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2548c5f5-bc1f-425c-a91b-0a4ed79c8f4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:32.927998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2548c5f5-bc1f-425c-a91b-0a4ed79c8f4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.928449 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2548c5f5-bc1f-425c-a91b-0a4ed79c8f4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:32.962553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-291cb152-f4f7-438a-8cf6-1b101b0320bf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:32.963435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-291cb152-f4f7-438a-8cf6-1b101b0320bf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:32.970001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-291cb152-f4f7-438a-8cf6-1b101b0320bf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.970450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-291cb152-f4f7-438a-8cf6-1b101b0320bf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:32.971227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-291cb152-f4f7-438a-8cf6-1b101b0320bf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:32.971662 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-291cb152-f4f7-438a-8cf6-1b101b0320bf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:33.071792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2548c5f5-bc1f-425c-a91b-0a4ed79c8f4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.156013 Jan 17 02:37:33.072490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 245/528] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:32 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:33.319418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:33.320131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:33.326832 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:33.327281 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:33.328083 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:33.328586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:33.470572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:33.478059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1e317219-e119-442d-8b44-6cdf1a4e8ee7 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.162835 Jan 17 02:37:33.478616 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 246/529] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:33 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:33.491578 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:33.492205 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:33.498492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:33.499060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:33.499875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:33.500368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:33.629785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:33.637545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1582c177-2e00-4bff-a10f-a69e0934ba2b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.149473 Jan 17 02:37:33.638087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 247/530] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:33 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:33.880820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-291cb152-f4f7-438a-8cf6-1b101b0320bf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.921750 Jan 17 02:37:33.881518 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 284/531] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:32 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:34.088385 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-208e4fd9-8187-4b10-bb22-b0fe27d3449b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:34.089343 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-208e4fd9-8187-4b10-bb22-b0fe27d3449b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:34.100016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-208e4fd9-8187-4b10-bb22-b0fe27d3449b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.100952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-208e4fd9-8187-4b10-bb22-b0fe27d3449b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:34.102245 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-208e4fd9-8187-4b10-bb22-b0fe27d3449b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.103497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-208e4fd9-8187-4b10-bb22-b0fe27d3449b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:34.420438 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-208e4fd9-8187-4b10-bb22-b0fe27d3449b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.338510 Jan 17 02:37:34.421098 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 248/532] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:34 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:34.499957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:34.501052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:34.507930 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.508406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:34.509167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.509600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:34.648441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:34.653980 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:34.654750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:34.655960 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-200c85a6-c2db-4ca0-a2f8-fc316631cde0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.163125 Jan 17 02:37:34.656558 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 285/533] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:34 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:34.661863 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.662300 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:34.663074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.663499 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:34.805926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:34.818466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cae3a5cb-a274-4037-811c-964342681054 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.168116 Jan 17 02:37:34.819414 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 249/534] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:34 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:34.894399 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d92ac77d-bf71-48bc-acaa-7e78883a4a56 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:34.895322 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d92ac77d-bf71-48bc-acaa-7e78883a4a56 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:34.903646 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d92ac77d-bf71-48bc-acaa-7e78883a4a56 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.904592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d92ac77d-bf71-48bc-acaa-7e78883a4a56 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:34.905383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d92ac77d-bf71-48bc-acaa-7e78883a4a56 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:34.905814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d92ac77d-bf71-48bc-acaa-7e78883a4a56 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:35.019798 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d92ac77d-bf71-48bc-acaa-7e78883a4a56 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.130244 Jan 17 02:37:35.020551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 286/535] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:34 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:35.431721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c4ac20f5-c7e7-4e61-948c-b03dd34f9c99 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:35.432691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c4ac20f5-c7e7-4e61-948c-b03dd34f9c99 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:35.439395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4ac20f5-c7e7-4e61-948c-b03dd34f9c99 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:35.439879 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4ac20f5-c7e7-4e61-948c-b03dd34f9c99 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:35.440690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4ac20f5-c7e7-4e61-948c-b03dd34f9c99 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:35.441411 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4ac20f5-c7e7-4e61-948c-b03dd34f9c99 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:35.554860 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c4ac20f5-c7e7-4e61-948c-b03dd34f9c99 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.126933 Jan 17 02:37:35.556018 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 250/536] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:35 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:35.674140 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:35.675555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:35.682498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:35.683152 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:35.684132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:35.684708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:35.839907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:35.841064 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:35.848378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:35.848708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:35.849710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:35.850147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:36.189902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:36.199608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-aee3e2cc-0052-44bc-b31b-157eb96781c5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.529384 Jan 17 02:37:36.200215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 287/537] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:35 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:36.204715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d50f9ca0-f90e-4ee2-aa3d-e8e19b8c0673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:36.205752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d50f9ca0-f90e-4ee2-aa3d-e8e19b8c0673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:36.212868 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50f9ca0-f90e-4ee2-aa3d-e8e19b8c0673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:36.213317 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50f9ca0-f90e-4ee2-aa3d-e8e19b8c0673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:36.214103 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50f9ca0-f90e-4ee2-aa3d-e8e19b8c0673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:36.214541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50f9ca0-f90e-4ee2-aa3d-e8e19b8c0673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:36.298467 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:36.306420 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ea5147db-8a18-4232-8bf0-f0f84b0447a1 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.471198 Jan 17 02:37:36.306997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 251/538] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:35 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:36.340189 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d50f9ca0-f90e-4ee2-aa3d-e8e19b8c0673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.138664 Jan 17 02:37:36.350037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 288/539] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:36 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:36.566794 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-734836be-1fd3-4335-adfd-034a48297726 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:36.567960 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-734836be-1fd3-4335-adfd-034a48297726 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:36.574708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-734836be-1fd3-4335-adfd-034a48297726 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:36.575153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-734836be-1fd3-4335-adfd-034a48297726 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:36.575939 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-734836be-1fd3-4335-adfd-034a48297726 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:36.576404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-734836be-1fd3-4335-adfd-034a48297726 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:36.697848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-734836be-1fd3-4335-adfd-034a48297726 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.134551 Jan 17 02:37:36.701869 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 252/540] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:36 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:37.216634 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:37.217577 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:37.225168 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.225617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.226420 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.226852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.323754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:37.324472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:37.332397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.332816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.333577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.334038 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.372142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:37.379976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d11059b0-9d2e-46d6-aa60-d552b13c4904 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.167521 Jan 17 02:37:37.380964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 289/541] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:37 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:37.385362 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6f88a952-a98e-44c8-83b1-af5fb5e62708 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:37.386273 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6f88a952-a98e-44c8-83b1-af5fb5e62708 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:37.392210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f88a952-a98e-44c8-83b1-af5fb5e62708 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.392727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f88a952-a98e-44c8-83b1-af5fb5e62708 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.393511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f88a952-a98e-44c8-83b1-af5fb5e62708 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.393947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f88a952-a98e-44c8-83b1-af5fb5e62708 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.483572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:37.491423 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-45a1e3a2-2897-4dd3-9b9b-f0360f550634 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.171641 Jan 17 02:37:37.491988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 253/542] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:37 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:37.504552 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6f88a952-a98e-44c8-83b1-af5fb5e62708 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.122229 Jan 17 02:37:37.505138 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 290/543] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:37 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:37.710483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-db5b1af0-ded2-4bae-95c2-8001871e7160 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:37.711668 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-db5b1af0-ded2-4bae-95c2-8001871e7160 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:37.719156 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db5b1af0-ded2-4bae-95c2-8001871e7160 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.719663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db5b1af0-ded2-4bae-95c2-8001871e7160 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.720879 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db5b1af0-ded2-4bae-95c2-8001871e7160 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:37.721256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db5b1af0-ded2-4bae-95c2-8001871e7160 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:37.856410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-db5b1af0-ded2-4bae-95c2-8001871e7160 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.149442 Jan 17 02:37:37.857908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 254/544] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:37 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:38.398321 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:38.399124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:38.407116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.407958 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:38.408870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.409314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:38.509053 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:38.509657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:38.516789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.517244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:38.518084 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.518515 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:38.546328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:38.554093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d163e9c0-7d02-4c25-a9ab-db32a291f0c8 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.160275 Jan 17 02:37:38.554669 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 291/545] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:38 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:38.559241 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-17d1b3ca-cf17-45e5-b900-12e60bebf70d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:38.560182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-17d1b3ca-cf17-45e5-b900-12e60bebf70d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:38.566027 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17d1b3ca-cf17-45e5-b900-12e60bebf70d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.566480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17d1b3ca-cf17-45e5-b900-12e60bebf70d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:38.567300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17d1b3ca-cf17-45e5-b900-12e60bebf70d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.567736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17d1b3ca-cf17-45e5-b900-12e60bebf70d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:38.653269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:38.661556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0b535798-18ef-4686-98df-9e0f87c453ca tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.156998 Jan 17 02:37:38.662148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 255/546] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:38 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:38.703792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-17d1b3ca-cf17-45e5-b900-12e60bebf70d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.147823 Jan 17 02:37:38.704749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 292/547] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:38 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:38.868061 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f685dd53-884b-487a-a7bb-f4cc1a9ae67d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:38.869026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f685dd53-884b-487a-a7bb-f4cc1a9ae67d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:38.875472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f685dd53-884b-487a-a7bb-f4cc1a9ae67d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.875932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f685dd53-884b-487a-a7bb-f4cc1a9ae67d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:38.876815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f685dd53-884b-487a-a7bb-f4cc1a9ae67d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:38.877262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f685dd53-884b-487a-a7bb-f4cc1a9ae67d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:39.509887 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f685dd53-884b-487a-a7bb-f4cc1a9ae67d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.645330 Jan 17 02:37:39.514597 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 256/548] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:38 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:39.571329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:39.572026 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:39.579336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:39.579792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:39.580666 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:39.581102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:39.679081 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:39.679794 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:39.686713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:39.687356 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:39.688169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:39.688606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:39.721475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:39.728924 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9a337570-4712-480b-b84e-b04085a80d75 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.161657 Jan 17 02:37:39.729496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 293/549] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:39 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:39.733994 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c372c19f-7085-4ae4-9a33-f3ddf275b163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:39.734902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c372c19f-7085-4ae4-9a33-f3ddf275b163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:39.742274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c372c19f-7085-4ae4-9a33-f3ddf275b163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:39.742730 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c372c19f-7085-4ae4-9a33-f3ddf275b163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:39.743517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c372c19f-7085-4ae4-9a33-f3ddf275b163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:39.743955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c372c19f-7085-4ae4-9a33-f3ddf275b163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:39.826288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:39.834351 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5a485052-08d9-42fe-a871-b2f98d1c4f46 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.159292 Jan 17 02:37:39.834915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 257/550] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:39 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:40.521965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-742a94f0-629d-4f7c-b7bb-d129a7a1fe25 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:40.523258 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-742a94f0-629d-4f7c-b7bb-d129a7a1fe25 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:40.530472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-742a94f0-629d-4f7c-b7bb-d129a7a1fe25 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:40.530951 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-742a94f0-629d-4f7c-b7bb-d129a7a1fe25 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:40.532102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-742a94f0-629d-4f7c-b7bb-d129a7a1fe25 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:40.532793 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-742a94f0-629d-4f7c-b7bb-d129a7a1fe25 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:44.269575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c372c19f-7085-4ae4-9a33-f3ddf275b163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 4.538796 Jan 17 02:37:44.272302 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 294/551] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:39 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 4541 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:44.276171 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:44.276960 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:44.285694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:44.286195 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:44.286977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:44.287429 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:44.424486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:44.432583 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-17c8a3f9-f0e0-43f4-b91a-fccd058dfd2d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.160670 Jan 17 02:37:44.433149 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 295/552] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:44 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:44.437326 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:44.437849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:44.443358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:44.443810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:44.444611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:44.445047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:44.583403 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:44.592596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-59b18d1c-9716-4727-896a-10180429329a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.157565 Jan 17 02:37:44.593186 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 296/553] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:44 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:45.281703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6cfe905e-5b47-49c3-a928-28ea81f7ee15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:45.282960 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6cfe905e-5b47-49c3-a928-28ea81f7ee15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:45.289448 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cfe905e-5b47-49c3-a928-28ea81f7ee15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:45.289893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cfe905e-5b47-49c3-a928-28ea81f7ee15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:45.290695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cfe905e-5b47-49c3-a928-28ea81f7ee15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:45.291123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cfe905e-5b47-49c3-a928-28ea81f7ee15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:46.663677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-742a94f0-629d-4f7c-b7bb-d129a7a1fe25 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 6.145105 Jan 17 02:37:46.665040 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 258/554] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:40 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 6147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:37:46.670084 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:46.670842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:46.678262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:46.678641 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:46.679447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:46.679876 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:46.683279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6cfe905e-5b47-49c3-a928-28ea81f7ee15 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 1.405132 Jan 17 02:37:46.687531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 297/555] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:45 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:46.689677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:46.690773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:46.698124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:46.698680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:46.699535 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:46.700408 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:46.889167 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:46.892787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:46.897007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8e098e52-2c62-4a32-a5f8-39d85c88ca80 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.230646 Jan 17 02:37:46.897560 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 259/556] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:46 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:46.901084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7b8f51f2-c2f6-4cb6-8aab-e47103a021e8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.215203 Jan 17 02:37:46.901729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 298/557] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:46 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:47.676348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c945e326-fc20-4658-9f10-779a424b5a3f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:47.677337 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c945e326-fc20-4658-9f10-779a424b5a3f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:47.683735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c945e326-fc20-4658-9f10-779a424b5a3f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.684211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c945e326-fc20-4658-9f10-779a424b5a3f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:47.685062 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c945e326-fc20-4658-9f10-779a424b5a3f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.685531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c945e326-fc20-4658-9f10-779a424b5a3f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:47.694749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c79e471e-9322-4f63-be9e-2ec785d01524 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:47.695785 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c79e471e-9322-4f63-be9e-2ec785d01524 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:47.702555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c79e471e-9322-4f63-be9e-2ec785d01524 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.703020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c79e471e-9322-4f63-be9e-2ec785d01524 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:47.704350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c79e471e-9322-4f63-be9e-2ec785d01524 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.704977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c79e471e-9322-4f63-be9e-2ec785d01524 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:47.830997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c945e326-fc20-4658-9f10-779a424b5a3f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.157879 Jan 17 02:37:47.831673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 260/558] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:47 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:47.875226 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c79e471e-9322-4f63-be9e-2ec785d01524 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.183495 Jan 17 02:37:47.876039 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 299/559] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:47 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:47.917341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:47.918142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:47.923901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:47.924743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:47.925719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.926166 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:47.926954 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.927414 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:47.932748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.932748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:47.933645 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:47.934180 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:48.115687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:48.124719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:48.128012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-35e2c4eb-b442-4c11-b549-8f4381643cf8 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.213378 Jan 17 02:37:48.129336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 300/560] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:47 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:48.133170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4a6f2287-ddc6-470d-b663-a22722b3c34b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.222339 Jan 17 02:37:48.133687 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 261/561] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:47 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:48.847987 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5d9f89c3-2b22-4eca-81f2-56595b7b4c66 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:48.849214 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5d9f89c3-2b22-4eca-81f2-56595b7b4c66 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:48.857489 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5d9f89c3-2b22-4eca-81f2-56595b7b4c66 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:48.857992 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5d9f89c3-2b22-4eca-81f2-56595b7b4c66 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:48.858860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5d9f89c3-2b22-4eca-81f2-56595b7b4c66 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:48.859340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5d9f89c3-2b22-4eca-81f2-56595b7b4c66 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:48.886878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2aa9c0b2-95c4-496e-a2c5-897edfa7c2bc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:48.887836 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2aa9c0b2-95c4-496e-a2c5-897edfa7c2bc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:48.895485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0b2-95c4-496e-a2c5-897edfa7c2bc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:48.895942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0b2-95c4-496e-a2c5-897edfa7c2bc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:48.896783 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0b2-95c4-496e-a2c5-897edfa7c2bc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:48.897216 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2aa9c0b2-95c4-496e-a2c5-897edfa7c2bc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:48.995929 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2aa9c0b2-95c4-496e-a2c5-897edfa7c2bc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.113037 Jan 17 02:37:48.996618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 262/562] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:48 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:49.029728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5d9f89c3-2b22-4eca-81f2-56595b7b4c66 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.187844 Jan 17 02:37:49.030401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 301/563] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:48 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:49.150328 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:49.151369 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:49.154365 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:49.155512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:49.163298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:49.164042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:49.165409 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:49.166087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:49.167077 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:49.168245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:49.169142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:49.169981 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:49.369822 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:49.373487 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:49.377217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2e4c54d9-e84e-48d0-8c54-09704f546fbd tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.229630 Jan 17 02:37:49.377766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 302/564] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:49 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:49.381712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1ca103e4-43bb-4e27-85a3-b75c05694e31 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.238205 Jan 17 02:37:49.382266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 263/565] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:49 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:50.007864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-329981fd-f97e-498f-8091-9978af6b0a67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:50.008828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-329981fd-f97e-498f-8091-9978af6b0a67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:50.017694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-329981fd-f97e-498f-8091-9978af6b0a67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.018192 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-329981fd-f97e-498f-8091-9978af6b0a67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.018979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-329981fd-f97e-498f-8091-9978af6b0a67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.019532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-329981fd-f97e-498f-8091-9978af6b0a67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.041673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-80a5e938-8f29-44d0-84ae-e160b7d75f32 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:50.042595 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-80a5e938-8f29-44d0-84ae-e160b7d75f32 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:50.050212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80a5e938-8f29-44d0-84ae-e160b7d75f32 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.050595 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80a5e938-8f29-44d0-84ae-e160b7d75f32 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.051418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80a5e938-8f29-44d0-84ae-e160b7d75f32 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.051921 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-80a5e938-8f29-44d0-84ae-e160b7d75f32 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.190659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-329981fd-f97e-498f-8091-9978af6b0a67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.186797 Jan 17 02:37:50.191664 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 303/566] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:50 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:50.228928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-80a5e938-8f29-44d0-84ae-e160b7d75f32 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.190439 Jan 17 02:37:50.229893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 264/567] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:50 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:50.395458 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:50.396447 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:50.398993 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:50.399727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:50.404658 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.405397 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.406470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.406933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.407773 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.407933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.408932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.409391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.605877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:50.609442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:50.613465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b08522c0-feb2-4f2d-a1fc-f867c8d406a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.222342 Jan 17 02:37:50.614071 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 304/568] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:50 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:50.617511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f98341c9-3c4d-4fc7-9b39-ebfd099030a7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.222618 Jan 17 02:37:50.618049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 265/569] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:50 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:50.618389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-738fc09f-b56c-4efc-81d5-1de86d428a06 req-cca2bbfa-de6f-420a-a69f-5add7a74bacb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b84647-19b2-4847-a95c-7fcff9ab436a", "name": "network-vif-plugged", "status": "completed", "tag": "0ee354e1-38b7-4917-b74d-ad4c255e5515"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:50.619892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:37:50.619892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:37:50.627004 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-738fc09f-b56c-4efc-81d5-1de86d428a06 req-cca2bbfa-de6f-420a-a69f-5add7a74bacb service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:50.627508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-738fc09f-b56c-4efc-81d5-1de86d428a06 req-cca2bbfa-de6f-420a-a69f-5add7a74bacb service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:50.638650 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-738fc09f-b56c-4efc-81d5-1de86d428a06 req-cca2bbfa-de6f-420a-a69f-5add7a74bacb service nova] Creating event network-vif-plugged:0ee354e1-38b7-4917-b74d-ad4c255e5515 for instance f9b84647-19b2-4847-a95c-7fcff9ab436a on hv-cinder-82160 Jan 17 02:37:50.643810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-738fc09f-b56c-4efc-81d5-1de86d428a06 req-cca2bbfa-de6f-420a-a69f-5add7a74bacb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028567 Jan 17 02:37:50.644437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 305/570] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:37:51.205176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-02da1d35-309a-4975-a7ed-2af215ec96c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:51.206135 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-02da1d35-309a-4975-a7ed-2af215ec96c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:51.213019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-02da1d35-309a-4975-a7ed-2af215ec96c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:51.213569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-02da1d35-309a-4975-a7ed-2af215ec96c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:51.214422 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-02da1d35-309a-4975-a7ed-2af215ec96c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:51.214919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-02da1d35-309a-4975-a7ed-2af215ec96c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:51.246580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b8c2327b-6ba5-426d-8e2c-f5a69f280621 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:51.247542 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b8c2327b-6ba5-426d-8e2c-f5a69f280621 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:51.253743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8c2327b-6ba5-426d-8e2c-f5a69f280621 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:51.254406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8c2327b-6ba5-426d-8e2c-f5a69f280621 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:51.255212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8c2327b-6ba5-426d-8e2c-f5a69f280621 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:51.255628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8c2327b-6ba5-426d-8e2c-f5a69f280621 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:52.090539 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b8c2327b-6ba5-426d-8e2c-f5a69f280621 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.848227 Jan 17 02:37:52.091321 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 306/571] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:51 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:52.096249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:52.096937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:52.104039 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:52.104526 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:52.105311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:52.105744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:52.113547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-02da1d35-309a-4975-a7ed-2af215ec96c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.911912 Jan 17 02:37:52.119920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 266/572] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:51 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:52.125363 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:52.126240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:52.134637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:52.135098 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:52.135882 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:52.139216 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:52.336315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:52.340424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:52.344163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-97e93069-65cc-43a7-b7f1-1a8068030af4 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.251693 Jan 17 02:37:52.344738 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 307/573] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:52 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:52.349411 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b193c732-6330-4b5f-b0f4-fd943b64ceb3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74c4c4e8-081e-4842-840f-26c16e01bfd9", "device": "/dev/sdb"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:52.351057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b193c732-6330-4b5f-b0f4-fd943b64ceb3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:52.351469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-77bf7ed4-e54a-4d8a-bbde-0d338b7ed063 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.230266 Jan 17 02:37:52.352049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 267/574] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:52 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:52.357870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b193c732-6330-4b5f-b0f4-fd943b64ceb3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:52.358522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b193c732-6330-4b5f-b0f4-fd943b64ceb3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:52.359377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b193c732-6330-4b5f-b0f4-fd943b64ceb3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:52.359781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b193c732-6330-4b5f-b0f4-fd943b64ceb3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:52.615360 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b193c732-6330-4b5f-b0f4-fd943b64ceb3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "POST /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269077 Jan 17 02:37:52.616055 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 308/575] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:37:52 2022] POST /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:37:53.105346 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b2733611-2775-406e-aad2-65300626721e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:53.106667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b2733611-2775-406e-aad2-65300626721e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:53.113663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b2733611-2775-406e-aad2-65300626721e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.114135 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b2733611-2775-406e-aad2-65300626721e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.114928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b2733611-2775-406e-aad2-65300626721e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.115356 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b2733611-2775-406e-aad2-65300626721e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.127124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-370b86f5-c2ac-49d7-b5d0-95a372dff6fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:53.128512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-370b86f5-c2ac-49d7-b5d0-95a372dff6fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:53.139856 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-370b86f5-c2ac-49d7-b5d0-95a372dff6fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.140729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-370b86f5-c2ac-49d7-b5d0-95a372dff6fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.141680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-370b86f5-c2ac-49d7-b5d0-95a372dff6fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.142325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-370b86f5-c2ac-49d7-b5d0-95a372dff6fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.264851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b2733611-2775-406e-aad2-65300626721e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.165068 Jan 17 02:37:53.265967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 268/576] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:53 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:53.295218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-370b86f5-c2ac-49d7-b5d0-95a372dff6fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.172376 Jan 17 02:37:53.297771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 309/577] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:53 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:37:53.362450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:53.363218 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:53.370414 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.370875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.371059 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:53.371650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.372180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.372595 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:53.379791 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.380445 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.381231 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:53.381659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:53.573499 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:53.576648 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:53.581476 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8692fbfc-d594-46bd-b48d-619d28f1be8d tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1317 microversion: 2.1 time: 0.223366 Jan 17 02:37:53.582050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 269/578] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:53 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:53.598872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7f876746-d5f1-4169-976a-d47501c433b3 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1567 microversion: 2.1 time: 0.232289 Jan 17 02:37:53.599622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 310/579] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:53 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:37:54.278256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1bc034ad-d38d-40df-ba65-3b795ba17897 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:54.279296 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1bc034ad-d38d-40df-ba65-3b795ba17897 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:54.285923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bc034ad-d38d-40df-ba65-3b795ba17897 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.286334 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bc034ad-d38d-40df-ba65-3b795ba17897 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.287166 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bc034ad-d38d-40df-ba65-3b795ba17897 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.287645 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bc034ad-d38d-40df-ba65-3b795ba17897 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.307065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c6289173-4537-4b0f-908c-f2e5d601111e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:54.308112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c6289173-4537-4b0f-908c-f2e5d601111e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:54.314592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6289173-4537-4b0f-908c-f2e5d601111e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.315141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6289173-4537-4b0f-908c-f2e5d601111e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.315948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6289173-4537-4b0f-908c-f2e5d601111e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.316413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6289173-4537-4b0f-908c-f2e5d601111e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.478248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1bc034ad-d38d-40df-ba65-3b795ba17897 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.203689 Jan 17 02:37:54.478810 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 270/580] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:54 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:54.494517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c6289173-4537-4b0f-908c-f2e5d601111e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.191097 Jan 17 02:37:54.495395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 311/581] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:54 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:54.598600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:54.599287 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:54.606523 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.606979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.607758 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.608222 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.616546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:54.617264 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:54.624683 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.625377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.626348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.626795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.809402 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:54.813691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:54.817082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-13c73569-b9e2-4904-a897-4ed111bcd4cb tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1507 microversion: 2.1 time: 0.222622 Jan 17 02:37:54.817693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 271/582] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:54 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:54.821940 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-188b5441-fe6c-4817-85f5-14c9d908e548 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1547 microversion: 2.1 time: 0.210080 Jan 17 02:37:54.822464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 312/583] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:54 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1547 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:54.837803 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:54.838302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:54.844200 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.844686 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.845473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.845907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.925525 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] HTTP exception thrown: Cannot 'detach_volume' instance 24ef95ec-9461-446c-ac23-d29814c0a4fa while it is in vm_state rescued Jan 17 02:37:54.926119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Returning 409 to user: Cannot 'detach_volume' instance 24ef95ec-9461-446c-ac23-d29814c0a4fa while it is in vm_state rescued {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:37:54.926940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0e5f0fc0-a868-4694-8295-07dc67896be7 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "DELETE /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments/32d81be3-6697-4308-b766-23dd5107a0c3" status: 409 len: 152 microversion: 2.1 time: 0.093032 Jan 17 02:37:54.927514 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 272/584] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:37:54 2022] DELETE /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments/32d81be3-6697-4308-b766-23dd5107a0c3 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 17 02:37:54.935668 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c2c128d3-4d0c-4c66-ba7f-8bdfd4dbd617 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:54.936229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c2c128d3-4d0c-4c66-ba7f-8bdfd4dbd617 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:54.942627 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2c128d3-4d0c-4c66-ba7f-8bdfd4dbd617 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.943115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2c128d3-4d0c-4c66-ba7f-8bdfd4dbd617 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:54.943948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2c128d3-4d0c-4c66-ba7f-8bdfd4dbd617 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:54.944515 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c2c128d3-4d0c-4c66-ba7f-8bdfd4dbd617 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:55.011176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c2c128d3-4d0c-4c66-ba7f-8bdfd4dbd617 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action" status: 202 len: 0 microversion: 2.1 time: 0.078982 Jan 17 02:37:55.012199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 313/585] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:54 2022] POST /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:55.019866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:55.020642 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:55.029843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:55.031513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:55.033608 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:55.034693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:55.283901 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:55.293018 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e09587cf-bdc1-4411-ace0-184451f4b101 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1555 microversion: 2.1 time: 0.276693 Jan 17 02:37:55.302729 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 273/586] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:55 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1555 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:55.491253 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-19ae247d-d79e-4d06-b867-3ce7da747af6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:55.492339 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-19ae247d-d79e-4d06-b867-3ce7da747af6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:55.499101 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-19ae247d-d79e-4d06-b867-3ce7da747af6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:55.499748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-19ae247d-d79e-4d06-b867-3ce7da747af6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:55.500350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-19ae247d-d79e-4d06-b867-3ce7da747af6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:55.500783 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-19ae247d-d79e-4d06-b867-3ce7da747af6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:55.507544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7b0823c2-fec5-4c15-8776-fab52ba042c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:55.508848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7b0823c2-fec5-4c15-8776-fab52ba042c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:55.515883 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7b0823c2-fec5-4c15-8776-fab52ba042c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:55.516701 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7b0823c2-fec5-4c15-8776-fab52ba042c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:55.517752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7b0823c2-fec5-4c15-8776-fab52ba042c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:55.518352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7b0823c2-fec5-4c15-8776-fab52ba042c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:55.615808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-19ae247d-d79e-4d06-b867-3ce7da747af6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.128929 Jan 17 02:37:55.616506 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 314/587] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:55 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:55.644000 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7b0823c2-fec5-4c15-8776-fab52ba042c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.140944 Jan 17 02:37:55.644641 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 274/588] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:55 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:55.679728 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:37:55.679914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:37:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:37:56.176602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1909324503", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:56.237941 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] validate_networks() for None {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:37:56.311073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:56.311761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:56.319442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.319915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.320792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.321277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.555240 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:37:56.555815 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:37:56.556348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:37:56.556763 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:37:56.557177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:37:56.566031 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.566485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.567301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.567748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.575604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:56.583623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-32327165-7f2f-4fbb-b8c5-009d1b85a2fc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1555 microversion: 2.1 time: 0.276568 Jan 17 02:37:56.584221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 275/589] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:56 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1555 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:56.589286 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Getting quotas for project 0d7e5e9c95504bb980d55c54a679de42. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:37:56.593308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Getting quotas for user ff29b450a5c54e44829db14df376bf64 and project 0d7e5e9c95504bb980d55c54a679de42. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:37:56.604300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:37:56.606742 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:37:56.627803 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3e295a5e-82d4-4a7a-8f20-383580de4a91 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:56.628926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3e295a5e-82d4-4a7a-8f20-383580de4a91 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:56.635768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e295a5e-82d4-4a7a-8f20-383580de4a91 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.636339 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e295a5e-82d4-4a7a-8f20-383580de4a91 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.638203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e295a5e-82d4-4a7a-8f20-383580de4a91 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.638754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e295a5e-82d4-4a7a-8f20-383580de4a91 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.655110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e546e7ba-5154-4061-b612-cb2ad6d5ec42 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482524 Jan 17 02:37:56.656457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 315/590] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:37:56.661463 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d0f7a0c8-44cc-497c-a065-ceb36745ebbf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:56.662700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d0f7a0c8-44cc-497c-a065-ceb36745ebbf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:56.669868 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0f7a0c8-44cc-497c-a065-ceb36745ebbf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.670443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0f7a0c8-44cc-497c-a065-ceb36745ebbf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.671361 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0f7a0c8-44cc-497c-a065-ceb36745ebbf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:56.671945 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0f7a0c8-44cc-497c-a065-ceb36745ebbf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:56.793724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3e295a5e-82d4-4a7a-8f20-383580de4a91 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.170040 Jan 17 02:37:56.794357 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 276/591] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:56 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:56.799687 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-09fb6ae1-6ce2-4e18-bfcd-747506428d62 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:56.800397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-09fb6ae1-6ce2-4e18-bfcd-747506428d62 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:56.811102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d0f7a0c8-44cc-497c-a065-ceb36745ebbf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.152833 Jan 17 02:37:56.811764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 316/592] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:56 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:56.861052 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-09fb6ae1-6ce2-4e18-bfcd-747506428d62 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:56.869240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-09fb6ae1-6ce2-4e18-bfcd-747506428d62 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1215 microversion: 2.1 time: 0.073685 Jan 17 02:37:56.869835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 277/593] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:56 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:57.197114 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e1824f40-f59d-4999-93af-55d65eb00a96 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ebec934-9549-4d14-8418-128b1607aee9"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:57.198283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e1824f40-f59d-4999-93af-55d65eb00a96 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:57.205418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1824f40-f59d-4999-93af-55d65eb00a96 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.206075 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1824f40-f59d-4999-93af-55d65eb00a96 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.206848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1824f40-f59d-4999-93af-55d65eb00a96 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.207260 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1824f40-f59d-4999-93af-55d65eb00a96 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.482383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e1824f40-f59d-4999-93af-55d65eb00a96 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "POST /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289361 Jan 17 02:37:57.482980 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 317/594] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:37:57 2022] POST /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:37:57.601188 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:57.602198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:57.608899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.609439 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.610290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.610937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.754215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:57.762637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1cd8b9cb-14a9-464b-8912-873bcf09714c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1555 microversion: 2.1 time: 0.165522 Jan 17 02:37:57.763210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 278/595] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:57 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:57.806256 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-78a56c71-aab8-4516-a5c7-4fab43422ab9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:57.807256 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-78a56c71-aab8-4516-a5c7-4fab43422ab9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:57.816008 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78a56c71-aab8-4516-a5c7-4fab43422ab9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.816492 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78a56c71-aab8-4516-a5c7-4fab43422ab9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.817277 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78a56c71-aab8-4516-a5c7-4fab43422ab9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.817711 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-78a56c71-aab8-4516-a5c7-4fab43422ab9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.822938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7e39bbd4-d0c5-4286-a512-d529fed08005 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:57.823861 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7e39bbd4-d0c5-4286-a512-d529fed08005 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:57.830513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7e39bbd4-d0c5-4286-a512-d529fed08005 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.831659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7e39bbd4-d0c5-4286-a512-d529fed08005 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.832484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7e39bbd4-d0c5-4286-a512-d529fed08005 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.832928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7e39bbd4-d0c5-4286-a512-d529fed08005 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.969101 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-78a56c71-aab8-4516-a5c7-4fab43422ab9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.167161 Jan 17 02:37:57.969748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 318/596] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:57 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:57.974583 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:57.975259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:57.982408 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.982848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:57.983621 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:57.984049 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:58.008283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7e39bbd4-d0c5-4286-a512-d529fed08005 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.188880 Jan 17 02:37:58.009113 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 279/597] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:57 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:58.049267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:58.057137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ec399322-f4f0-4813-a013-9b9f128816dd tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1267 microversion: 2.1 time: 0.086217 Jan 17 02:37:58.057692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 319/598] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:57 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:58.780485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:58.781113 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:58.788604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:58.789059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:58.789863 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:58.790281 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:58.973580 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:58.982148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-907c6a6c-b600-42d1-a3c5-980a01af4a0b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:58.983303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-907c6a6c-b600-42d1-a3c5-980a01af4a0b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:58.983493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-31f970ef-3b48-414c-8345-701c9a0fc721 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1555 microversion: 2.1 time: 0.207176 Jan 17 02:37:58.993074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 280/599] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:58 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:37:58.994501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-907c6a6c-b600-42d1-a3c5-980a01af4a0b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:58.994976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-907c6a6c-b600-42d1-a3c5-980a01af4a0b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:58.995800 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-907c6a6c-b600-42d1-a3c5-980a01af4a0b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:58.996317 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-907c6a6c-b600-42d1-a3c5-980a01af4a0b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:59.020248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-df4a96fd-88fd-4665-836c-1ecc3a0cc3e6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:37:59.029507 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-df4a96fd-88fd-4665-836c-1ecc3a0cc3e6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:59.037214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df4a96fd-88fd-4665-836c-1ecc3a0cc3e6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:59.037708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df4a96fd-88fd-4665-836c-1ecc3a0cc3e6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:59.038563 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df4a96fd-88fd-4665-836c-1ecc3a0cc3e6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:59.039050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df4a96fd-88fd-4665-836c-1ecc3a0cc3e6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:59.143137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-907c6a6c-b600-42d1-a3c5-980a01af4a0b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.165843 Jan 17 02:37:59.147164 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 320/600] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:37:58 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:37:59.148914 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:37:59.149611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:37:59.156708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:59.157546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:59.158340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:37:59.159435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:37:59.169951 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-df4a96fd-88fd-4665-836c-1ecc3a0cc3e6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.153257 Jan 17 02:37:59.170720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 281/601] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:37:59 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:37:59.229849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:37:59.237369 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9f9527ee-af0d-4c44-ab87-d14a9a6c91e6 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1273 microversion: 2.1 time: 0.092428 Jan 17 02:37:59.237908 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 321/602] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:59 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:00.000735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:00.002046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:00.009101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.010217 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.011089 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.011494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.154926 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a70daa07-db98-425a-ab20-9e4add64f83b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:00.155894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a70daa07-db98-425a-ab20-9e4add64f83b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:00.164612 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a70daa07-db98-425a-ab20-9e4add64f83b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.165062 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a70daa07-db98-425a-ab20-9e4add64f83b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.165860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a70daa07-db98-425a-ab20-9e4add64f83b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.166350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a70daa07-db98-425a-ab20-9e4add64f83b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.257874 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:00.271663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-35d6ef85-7e51-481d-ab95-4e46d21191f9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1555 microversion: 2.1 time: 0.274625 Jan 17 02:38:00.272968 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 282/603] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:37:59 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1555 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:00.279878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f910486c-7a36-4c0e-a281-d41c88dc2b66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:00.280979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f910486c-7a36-4c0e-a281-d41c88dc2b66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:00.286998 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a70daa07-db98-425a-ab20-9e4add64f83b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.135745 Jan 17 02:38:00.287653 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 322/604] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:00 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:00.293181 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f910486c-7a36-4c0e-a281-d41c88dc2b66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.293920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f910486c-7a36-4c0e-a281-d41c88dc2b66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.294989 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:00.295603 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f910486c-7a36-4c0e-a281-d41c88dc2b66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.296241 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:00.296534 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f910486c-7a36-4c0e-a281-d41c88dc2b66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.306024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.306565 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.314259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.316607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.406095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f910486c-7a36-4c0e-a281-d41c88dc2b66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.130870 Jan 17 02:38:00.407915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 283/605] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:00 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:00.482403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-91c18744-e4f1-4452-8450-7cba2bab900c req-bd3d6497-35ea-4375-b901-4650835c82a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de2d50d-8380-4b0e-a6cc-598a5101eec7", "tag": "bb496404-62f2-4492-994f-87c052ecfb65"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:00.490998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:00.490998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:00.498995 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-91c18744-e4f1-4452-8450-7cba2bab900c req-bd3d6497-35ea-4375-b901-4650835c82a9 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:00.499796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-91c18744-e4f1-4452-8450-7cba2bab900c req-bd3d6497-35ea-4375-b901-4650835c82a9 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:00.512875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-91c18744-e4f1-4452-8450-7cba2bab900c req-bd3d6497-35ea-4375-b901-4650835c82a9 service nova] Creating event network-changed:bb496404-62f2-4492-994f-87c052ecfb65 for instance 3de2d50d-8380-4b0e-a6cc-598a5101eec7 on hv-cinder-82160 Jan 17 02:38:00.518042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-91c18744-e4f1-4452-8450-7cba2bab900c req-bd3d6497-35ea-4375-b901-4650835c82a9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039467 Jan 17 02:38:00.519594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 284/606] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:38:00.571076 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:00.591009 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6718a227-398a-4ae1-8bf2-8f16eafd1ee8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.301690 Jan 17 02:38:00.592802 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 323/607] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:00 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:00.598458 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-549410196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-323961130", "security_groups": [{"name": "tempest-secgroup-smoke-945077347"}], "networks": [{"uuid": "dc9234fe-3a43-4208-a1dc-e9ba7e69bac1"}], "block_device_mapping_v2": [{"uuid": "ce6184d0-635a-46aa-a700-8e24e6d42be9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:00.775729 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] validate_networks() for [('dc9234fe-3a43-4208-a1dc-e9ba7e69bac1', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:38:01.290406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:01.291820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:01.299460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.299801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.300629 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.301072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.318662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:38:01.319759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:38:01.320287 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:38:01.320688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:38:01.321091 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:38:01.335342 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.336097 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.337068 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.339843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.364168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Getting quotas for project 0dec6844a62b4685a182219dbf9bea72. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:38:01.367074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Getting quotas for user 3066aac319784300b9d8f0c1c8f298ca and project 0dec6844a62b4685a182219dbf9bea72. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:38:01.436783 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:38:01.439022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce6184d0-635a-46aa-a700-8e24e6d42be9',volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:38:01.539018 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:01.549766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5ecbeebf-ad04-4416-9a39-bed93b33ab39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1561 microversion: 2.1 time: 0.264247 Jan 17 02:38:01.550532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 324/608] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:01 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1561 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:01.555051 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-798b3e90-e86c-4a2c-bd65-d80ed771e28d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:01.556025 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-798b3e90-e86c-4a2c-bd65-d80ed771e28d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:01.561887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-798b3e90-e86c-4a2c-bd65-d80ed771e28d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.562604 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-798b3e90-e86c-4a2c-bd65-d80ed771e28d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.563656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-798b3e90-e86c-4a2c-bd65-d80ed771e28d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.564409 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-798b3e90-e86c-4a2c-bd65-d80ed771e28d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.568060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0aad1a26-2629-4ea3-8c7e-14ffe494d79e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.974161 Jan 17 02:38:01.568869 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 285/609] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:38:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 17 02:38:01.575445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4382f7b2-8826-49b9-aa50-bf838069686e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:01.576614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4382f7b2-8826-49b9-aa50-bf838069686e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:01.583430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4382f7b2-8826-49b9-aa50-bf838069686e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.584439 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4382f7b2-8826-49b9-aa50-bf838069686e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.585455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4382f7b2-8826-49b9-aa50-bf838069686e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.586064 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4382f7b2-8826-49b9-aa50-bf838069686e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.771517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-798b3e90-e86c-4a2c-bd65-d80ed771e28d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.219552 Jan 17 02:38:01.772436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 325/610] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:01 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:01.777413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c5f548e8-f59e-49d7-8f62-ae173bc519ca tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:01.778312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c5f548e8-f59e-49d7-8f62-ae173bc519ca tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:01.790902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4382f7b2-8826-49b9-aa50-bf838069686e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.220685 Jan 17 02:38:01.791572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 286/611] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:01 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:01.796657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:01.797549 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:01.804159 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.804685 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.805364 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.805789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.840155 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c5f548e8-f59e-49d7-8f62-ae173bc519ca tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:01.847262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c5f548e8-f59e-49d7-8f62-ae173bc519ca tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1087 microversion: 2.1 time: 0.073616 Jan 17 02:38:01.849908 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 326/612] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:01 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1087 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:01.857300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:01.857945 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:01.865299 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.865744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.866729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:01.867207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:01.956126 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lazy-loading 'services' on Instance uuid 24ef95ec-9461-446c-ac23-d29814c0a4fa {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:01.962522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:01.969940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ea7efc8f-789a-4bee-af04-2f93a4d52cbb tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.177031 Jan 17 02:38:01.970490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 287/613] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:01 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:02.032512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-16b8e2db-dd03-48a5-8d1f-b36165135110 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "DELETE /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments/32d81be3-6697-4308-b766-23dd5107a0c3" status: 202 len: 0 microversion: 2.1 time: 0.182361 Jan 17 02:38:02.033110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 327/614] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:38:01 2022] DELETE /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments/32d81be3-6697-4308-b766-23dd5107a0c3 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:02.041571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-46ee9dc8-cf90-42c7-b95c-be753c93ff39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:02.042505 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-46ee9dc8-cf90-42c7-b95c-be753c93ff39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:02.048672 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46ee9dc8-cf90-42c7-b95c-be753c93ff39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:02.049120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46ee9dc8-cf90-42c7-b95c-be753c93ff39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:02.049888 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46ee9dc8-cf90-42c7-b95c-be753c93ff39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:02.050319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-46ee9dc8-cf90-42c7-b95c-be753c93ff39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:02.080562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-46ee9dc8-cf90-42c7-b95c-be753c93ff39 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 Jan 17 02:38:02.081016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 288/615] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:02 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:02.784287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1a984dd1-4471-45f5-a949-40895524bd5f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:02.785380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1a984dd1-4471-45f5-a949-40895524bd5f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:02.793291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a984dd1-4471-45f5-a949-40895524bd5f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:02.793829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a984dd1-4471-45f5-a949-40895524bd5f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:02.794694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a984dd1-4471-45f5-a949-40895524bd5f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:02.795369 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a984dd1-4471-45f5-a949-40895524bd5f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:02.805156 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0ce21c9d-3e8e-470d-bdb2-13ca14612103 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:02.806101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0ce21c9d-3e8e-470d-bdb2-13ca14612103 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:02.812573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ce21c9d-3e8e-470d-bdb2-13ca14612103 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:02.813026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ce21c9d-3e8e-470d-bdb2-13ca14612103 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:02.813806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ce21c9d-3e8e-470d-bdb2-13ca14612103 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:02.814249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0ce21c9d-3e8e-470d-bdb2-13ca14612103 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:05.290671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1a984dd1-4471-45f5-a949-40895524bd5f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 2.510898 Jan 17 02:38:05.291938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 328/616] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:02 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:05.297451 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:05.298112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:05.305302 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:05.305750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:05.306739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:05.307221 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:05.367741 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:05.375770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-631087d1-a0c2-45e1-b73c-91b09c10f4aa tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1185 microversion: 2.1 time: 0.082655 Jan 17 02:38:05.376471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 329/617] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:05 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:05.380610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:05.381198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:05.386805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:05.387254 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:05.388022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:05.388468 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:05.524866 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:05.535567 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-701b22f2-8ed2-4b8d-b4e4-337fb453f35f tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.157920 Jan 17 02:38:05.536417 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 330/618] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:05 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:05.540693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-03934fe7-a690-4b24-8cba-cad52d8b1947 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:05.541823 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-03934fe7-a690-4b24-8cba-cad52d8b1947 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:05.548983 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03934fe7-a690-4b24-8cba-cad52d8b1947 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:05.549598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03934fe7-a690-4b24-8cba-cad52d8b1947 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:05.550780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03934fe7-a690-4b24-8cba-cad52d8b1947 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:05.551400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03934fe7-a690-4b24-8cba-cad52d8b1947 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:05.581970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-03934fe7-a690-4b24-8cba-cad52d8b1947 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Jan 17 02:38:05.582509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 331/619] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:05 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:06.302088 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b6b125f9-04c7-427f-b12a-7edef6031909 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:06.303000 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b6b125f9-04c7-427f-b12a-7edef6031909 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:06.309817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6b125f9-04c7-427f-b12a-7edef6031909 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:06.310267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6b125f9-04c7-427f-b12a-7edef6031909 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:06.311034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6b125f9-04c7-427f-b12a-7edef6031909 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:06.311471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6b125f9-04c7-427f-b12a-7edef6031909 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:06.902029 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0ce21c9d-3e8e-470d-bdb2-13ca14612103 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 4.100009 Jan 17 02:38:06.902801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 289/620] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:02 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 4102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:06.908397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:06.909151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:06.917068 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:06.917568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:06.918435 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:06.918915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:06.980233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:06.988086 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2af4d0c5-797e-4c40-be01-d182be9deb55 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1185 microversion: 2.1 time: 0.084114 Jan 17 02:38:06.988661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 290/621] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:06 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:06.992750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:06.993353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:06.999141 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:06.999589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:07.000391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:07.000830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:07.129746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:07.140096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-47a7f7e8-d512-487d-aff2-6c0b1cbe90e4 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.150510 Jan 17 02:38:07.140699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 291/622] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:06 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:07.145028 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-43238edd-30c3-4828-a1f9-88ab8648b95f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:07.145918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-43238edd-30c3-4828-a1f9-88ab8648b95f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:07.151614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43238edd-30c3-4828-a1f9-88ab8648b95f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:07.152156 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43238edd-30c3-4828-a1f9-88ab8648b95f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:07.152919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43238edd-30c3-4828-a1f9-88ab8648b95f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:07.153353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-43238edd-30c3-4828-a1f9-88ab8648b95f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:07.184019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-43238edd-30c3-4828-a1f9-88ab8648b95f tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 Jan 17 02:38:07.184774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 292/623] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:07 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:07.525087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b6b125f9-04c7-427f-b12a-7edef6031909 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 1.225924 Jan 17 02:38:07.525675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 332/624] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:06 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:07.917977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-95b83a15-bea2-4b7c-b82c-49e65569e235 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:07.918976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-95b83a15-bea2-4b7c-b82c-49e65569e235 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:07.925736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95b83a15-bea2-4b7c-b82c-49e65569e235 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:07.926199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95b83a15-bea2-4b7c-b82c-49e65569e235 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:07.926976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95b83a15-bea2-4b7c-b82c-49e65569e235 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:07.927406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-95b83a15-bea2-4b7c-b82c-49e65569e235 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.007257 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:08.007944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:08.015260 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.015823 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.016683 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.017113 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.079406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:08.087685 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5a85f557-156c-4b05-9e81-a77e9d5f58cc tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1193 microversion: 2.1 time: 0.085712 Jan 17 02:38:08.097228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 333/625] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:07 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:08.157410 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:08.158040 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:08.164178 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.164832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.165613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.166091 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.307794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:08.315996 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7b1b6864-207f-4484-a261-75708ce0090d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.162747 Jan 17 02:38:08.316627 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 334/626] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:08 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:08.321081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-512ff9a2-98af-4b73-a3e0-20ca92bade09 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:08.321979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-512ff9a2-98af-4b73-a3e0-20ca92bade09 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:08.327732 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-512ff9a2-98af-4b73-a3e0-20ca92bade09 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.328222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-512ff9a2-98af-4b73-a3e0-20ca92bade09 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.329011 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-512ff9a2-98af-4b73-a3e0-20ca92bade09 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.329439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-512ff9a2-98af-4b73-a3e0-20ca92bade09 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.359069 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-512ff9a2-98af-4b73-a3e0-20ca92bade09 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Jan 17 02:38:08.359619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 335/627] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:08 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:08.539127 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7344a7d2-86e2-4eb8-9986-74a0c9c4f871 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:08.540245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7344a7d2-86e2-4eb8-9986-74a0c9c4f871 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:08.549024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7344a7d2-86e2-4eb8-9986-74a0c9c4f871 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.549622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7344a7d2-86e2-4eb8-9986-74a0c9c4f871 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:08.550648 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7344a7d2-86e2-4eb8-9986-74a0c9c4f871 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:08.551222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7344a7d2-86e2-4eb8-9986-74a0c9c4f871 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:12.514415 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-95b83a15-bea2-4b7c-b82c-49e65569e235 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 4.601879 Jan 17 02:38:12.515010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 293/628] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:07 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 4604 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:12.519707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:12.520440 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:12.528354 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:12.528802 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:12.529617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:12.530039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:12.630065 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:12.637880 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-44abcbd2-35de-4ee0-bb59-62bf65f12760 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1203 microversion: 2.1 time: 0.122003 Jan 17 02:38:12.638535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 294/629] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:12 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1203 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:12.642798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:12.643428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:12.649463 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:12.649925 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:12.650704 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:12.651140 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:12.870270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:12.879679 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-177516a3-3626-4993-ac46-0f4dfd7608d5 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.239760 Jan 17 02:38:12.889336 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 295/630] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:12 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:12.889336 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c09506fb-da0f-4389-b3ef-6f75434df864 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:12.889336 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c09506fb-da0f-4389-b3ef-6f75434df864 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:12.893220 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c09506fb-da0f-4389-b3ef-6f75434df864 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:12.893736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c09506fb-da0f-4389-b3ef-6f75434df864 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:12.894549 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c09506fb-da0f-4389-b3ef-6f75434df864 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:12.894978 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c09506fb-da0f-4389-b3ef-6f75434df864 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:12.925237 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c09506fb-da0f-4389-b3ef-6f75434df864 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Jan 17 02:38:12.929005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 296/631] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:12 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:13.301303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7344a7d2-86e2-4eb8-9986-74a0c9c4f871 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 4.766353 Jan 17 02:38:13.305904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 336/632] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:08 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 4769 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:13.526313 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b1abfebd-ef41-49bb-a293-45485325296a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:13.527235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b1abfebd-ef41-49bb-a293-45485325296a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:13.534240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1abfebd-ef41-49bb-a293-45485325296a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:13.534682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1abfebd-ef41-49bb-a293-45485325296a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:13.535483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1abfebd-ef41-49bb-a293-45485325296a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:13.535907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b1abfebd-ef41-49bb-a293-45485325296a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:13.656438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:13.657827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:13.666154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:13.666609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:13.667595 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:13.668028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:13.707659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b1abfebd-ef41-49bb-a293-45485325296a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.184995 Jan 17 02:38:13.708336 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 297/633] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:13 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:13.870713 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:13.882769 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6e7e013d-36e6-44aa-bab5-41c28ea4ddd8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1270 microversion: 2.1 time: 0.230715 Jan 17 02:38:13.884121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 337/634] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:13 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:13.897996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:13.898750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:13.910530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:13.910972 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:13.912426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:13.913032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:13.938236 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-6032777d-ffec-46a2-abf5-e95e2f4e518c req-b398bf87-d630-4fe3-b78e-608739b3820c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836aee89-f8f7-4788-8051-2d62fd7adacb", "tag": "c601475c-0c44-4ca7-a396-6569cecefedc"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:13.943972 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:13.943972 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:38:13.963715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-6032777d-ffec-46a2-abf5-e95e2f4e518c req-b398bf87-d630-4fe3-b78e-608739b3820c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:13.964446 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-6032777d-ffec-46a2-abf5-e95e2f4e518c req-b398bf87-d630-4fe3-b78e-608739b3820c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:13.978637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-6032777d-ffec-46a2-abf5-e95e2f4e518c req-b398bf87-d630-4fe3-b78e-608739b3820c service nova] Creating event network-changed:c601475c-0c44-4ca7-a396-6569cecefedc for instance 836aee89-f8f7-4788-8051-2d62fd7adacb on hv-cinder-82160 Jan 17 02:38:13.984471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-6032777d-ffec-46a2-abf5-e95e2f4e518c req-b398bf87-d630-4fe3-b78e-608739b3820c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055096 Jan 17 02:38:13.985697 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 338/635] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:13.992446 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3552ce0d-2b18-4ffc-9759-c74f5a840df5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:13.993444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3552ce0d-2b18-4ffc-9759-c74f5a840df5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:14.008507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3552ce0d-2b18-4ffc-9759-c74f5a840df5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.009036 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3552ce0d-2b18-4ffc-9759-c74f5a840df5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.012002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3552ce0d-2b18-4ffc-9759-c74f5a840df5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.012474 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3552ce0d-2b18-4ffc-9759-c74f5a840df5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.059832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3552ce0d-2b18-4ffc-9759-c74f5a840df5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072402 Jan 17 02:38:14.060978 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 339/636] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:13 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:14.151328 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:14.166249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5a5f95d2-2f21-4258-973c-b7cf91da6e26 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.272245 Jan 17 02:38:14.166892 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 298/637] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:13 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:14.314288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-96fa6645-8e0d-4403-bdc0-dd0f0cd08299 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:14.315184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-96fa6645-8e0d-4403-bdc0-dd0f0cd08299 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:14.321637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96fa6645-8e0d-4403-bdc0-dd0f0cd08299 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.322090 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96fa6645-8e0d-4403-bdc0-dd0f0cd08299 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.322869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96fa6645-8e0d-4403-bdc0-dd0f0cd08299 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.323306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-96fa6645-8e0d-4403-bdc0-dd0f0cd08299 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.555379 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-96fa6645-8e0d-4403-bdc0-dd0f0cd08299 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.244653 Jan 17 02:38:14.559334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 340/638] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:14 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:14.596695 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:14.597264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:14.603629 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.604136 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.604893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.605316 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.685381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lazy-loading 'services' on Instance uuid f9b84647-19b2-4847-a95c-7fcff9ab436a {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:14.719263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-62bc51ac-1707-4192-9db1-6496446edb87 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:14.720423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-62bc51ac-1707-4192-9db1-6496446edb87 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:14.727642 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62bc51ac-1707-4192-9db1-6496446edb87 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.728105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62bc51ac-1707-4192-9db1-6496446edb87 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.728937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62bc51ac-1707-4192-9db1-6496446edb87 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.729375 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-62bc51ac-1707-4192-9db1-6496446edb87 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.759455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a0c424e7-ee17-4a19-846b-d2b36a130be6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments/6ebec934-9549-4d14-8418-128b1607aee9" status: 202 len: 0 microversion: 2.1 time: 0.166434 Jan 17 02:38:14.760049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 299/639] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:38:14 2022] DELETE /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments/6ebec934-9549-4d14-8418-128b1607aee9 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:14.768444 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-465b591f-f2ef-41f1-b121-18f07fba24f5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:14.769497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-465b591f-f2ef-41f1-b121-18f07fba24f5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:14.775838 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-465b591f-f2ef-41f1-b121-18f07fba24f5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.776314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-465b591f-f2ef-41f1-b121-18f07fba24f5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.777101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-465b591f-f2ef-41f1-b121-18f07fba24f5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.777543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-465b591f-f2ef-41f1-b121-18f07fba24f5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.806760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-465b591f-f2ef-41f1-b121-18f07fba24f5 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 Jan 17 02:38:14.807407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 300/640] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:14 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:14.903761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:14.904792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:14.912835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.913207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:14.913979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:14.914412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:15.055684 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:15.063584 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d11b6370-cfe9-4983-93f1-920a09fcce62 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1270 microversion: 2.1 time: 0.165891 Jan 17 02:38:15.064175 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 301/641] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:14 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:15.071542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d0473bbd-5169-4da1-90ca-bbcf6de7dd18 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:15.072465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d0473bbd-5169-4da1-90ca-bbcf6de7dd18 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:15.081116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0473bbd-5169-4da1-90ca-bbcf6de7dd18 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:15.081692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0473bbd-5169-4da1-90ca-bbcf6de7dd18 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:15.082750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0473bbd-5169-4da1-90ca-bbcf6de7dd18 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:15.083396 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0473bbd-5169-4da1-90ca-bbcf6de7dd18 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:15.116931 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d0473bbd-5169-4da1-90ca-bbcf6de7dd18 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048827 Jan 17 02:38:15.117480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 302/642] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:15 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:15.186119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:15.186998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:15.193721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:15.194174 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:15.194963 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:15.195400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:15.558274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:15.569078 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b72f4018-35a9-452d-8795-58cf6fdd01d8 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.388686 Jan 17 02:38:15.569991 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 303/643] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:15 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:15.574230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-76c37e26-b5f9-437b-8ab5-365d6e8d15bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:15.575122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-76c37e26-b5f9-437b-8ab5-365d6e8d15bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:15.580996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-76c37e26-b5f9-437b-8ab5-365d6e8d15bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:15.581451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-76c37e26-b5f9-437b-8ab5-365d6e8d15bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:15.582224 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-76c37e26-b5f9-437b-8ab5-365d6e8d15bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:15.582658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-76c37e26-b5f9-437b-8ab5-365d6e8d15bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.751949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-62bc51ac-1707-4192-9db1-6496446edb87 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 5.036611 Jan 17 02:38:19.755899 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 341/644] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:14 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 5038 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:38:19.757901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7e3f87cc-3b4b-46e0-aad8-2dff32ce3ea2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:19.761136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7e3f87cc-3b4b-46e0-aad8-2dff32ce3ea2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:19.768163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e3f87cc-3b4b-46e0-aad8-2dff32ce3ea2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.768613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e3f87cc-3b4b-46e0-aad8-2dff32ce3ea2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.769398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e3f87cc-3b4b-46e0-aad8-2dff32ce3ea2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.769832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e3f87cc-3b4b-46e0-aad8-2dff32ce3ea2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.799944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7e3f87cc-3b4b-46e0-aad8-2dff32ce3ea2 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045967 Jan 17 02:38:19.800474 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 342/645] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:19 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:19.804619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:19.805202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:19.811112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.811555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.812345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.812771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.825851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-76c37e26-b5f9-437b-8ab5-365d6e8d15bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 4.254531 Jan 17 02:38:19.827916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 304/646] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:15 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 4257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:19.832989 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8f809c3d-0dda-4a72-8300-da087f1d4af0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:19.834189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8f809c3d-0dda-4a72-8300-da087f1d4af0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:19.842148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f809c3d-0dda-4a72-8300-da087f1d4af0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.842815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f809c3d-0dda-4a72-8300-da087f1d4af0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.843758 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f809c3d-0dda-4a72-8300-da087f1d4af0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.844367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8f809c3d-0dda-4a72-8300-da087f1d4af0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.877309 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8f809c3d-0dda-4a72-8300-da087f1d4af0 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048028 Jan 17 02:38:19.877788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 305/647] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:19 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:19.882361 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:19.883183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:19.890044 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.890488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:19.891437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:19.892012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.064167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:20.072244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-131112cf-5445-4362-b268-b8e6f8bf9d54 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1270 microversion: 2.1 time: 0.270707 Jan 17 02:38:20.073162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 343/648] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:19 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:20.150961 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:20.159016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-faabee4c-a0b4-4402-bf26-f5ee425b3aa3 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.280076 Jan 17 02:38:20.159628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 306/649] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:19 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:20.763856 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-be69abb7-c261-4c92-9d4c-ee0062807521 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:20.764801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-be69abb7-c261-4c92-9d4c-ee0062807521 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:20.771340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be69abb7-c261-4c92-9d4c-ee0062807521 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.771789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be69abb7-c261-4c92-9d4c-ee0062807521 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.772580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be69abb7-c261-4c92-9d4c-ee0062807521 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.773014 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be69abb7-c261-4c92-9d4c-ee0062807521 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.810911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-834ccce8-6687-4613-8842-d06b4d605247 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:20.811820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-834ccce8-6687-4613-8842-d06b4d605247 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:20.818291 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-834ccce8-6687-4613-8842-d06b4d605247 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.818715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-834ccce8-6687-4613-8842-d06b4d605247 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.819496 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-834ccce8-6687-4613-8842-d06b4d605247 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.819922 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-834ccce8-6687-4613-8842-d06b4d605247 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.849020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-834ccce8-6687-4613-8842-d06b4d605247 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Jan 17 02:38:20.849632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 307/650] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:20 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:38:20.853830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-58cd8830-fb09-4c47-93d6-918431ac5998 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:20.854710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-58cd8830-fb09-4c47-93d6-918431ac5998 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:20.861664 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-58cd8830-fb09-4c47-93d6-918431ac5998 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.862120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-58cd8830-fb09-4c47-93d6-918431ac5998 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.862933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-58cd8830-fb09-4c47-93d6-918431ac5998 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.863391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-58cd8830-fb09-4c47-93d6-918431ac5998 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.959256 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-be69abb7-c261-4c92-9d4c-ee0062807521 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.198982 Jan 17 02:38:20.959911 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 344/651] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:20 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:20.965201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-444726b8-9895-4f21-9b66-3fb97f957f75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:20.966181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-444726b8-9895-4f21-9b66-3fb97f957f75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:20.972842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444726b8-9895-4f21-9b66-3fb97f957f75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.973276 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444726b8-9895-4f21-9b66-3fb97f957f75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:20.974053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444726b8-9895-4f21-9b66-3fb97f957f75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:20.974469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444726b8-9895-4f21-9b66-3fb97f957f75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.004017 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-444726b8-9895-4f21-9b66-3fb97f957f75 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042427 Jan 17 02:38:21.004620 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 345/652] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:20 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:38:21.055073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-58cd8830-fb09-4c47-93d6-918431ac5998 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.204299 Jan 17 02:38:21.055677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 308/653] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:20 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:21.088690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:21.089278 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:21.095929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.096415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.097192 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.097628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.175562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:21.176406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:21.183851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.184348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.185142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.185561 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.242288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:21.249953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ee735551-95e8-4d56-a126-d5bc46af7574 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1270 microversion: 2.1 time: 0.164805 Jan 17 02:38:21.250523 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 346/654] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:21 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:21.328850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:21.337634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-55158cc5-2ba9-4154-949f-f40f6edb7566 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.166428 Jan 17 02:38:21.338212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 309/655] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:21 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:21.864431 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1db2d355-3dac-4ebe-a4b6-fd238d1d3cee tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:21.865793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1db2d355-3dac-4ebe-a4b6-fd238d1d3cee tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:21.876533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1db2d355-3dac-4ebe-a4b6-fd238d1d3cee tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.877289 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1db2d355-3dac-4ebe-a4b6-fd238d1d3cee tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.878577 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1db2d355-3dac-4ebe-a4b6-fd238d1d3cee tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.879381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1db2d355-3dac-4ebe-a4b6-fd238d1d3cee tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.910165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1db2d355-3dac-4ebe-a4b6-fd238d1d3cee tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052225 Jan 17 02:38:21.910990 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 347/656] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:21 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:21.971245 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9a3b914a-177b-434b-adc3-9bb98027dcd2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:21.972183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9a3b914a-177b-434b-adc3-9bb98027dcd2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:21.978565 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a3b914a-177b-434b-adc3-9bb98027dcd2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.979014 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a3b914a-177b-434b-adc3-9bb98027dcd2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:21.979821 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a3b914a-177b-434b-adc3-9bb98027dcd2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:21.980297 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a3b914a-177b-434b-adc3-9bb98027dcd2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.066824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2c174f3a-fc07-4aa0-9e86-29780b7f1dc8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:22.067814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2c174f3a-fc07-4aa0-9e86-29780b7f1dc8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:22.074329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c174f3a-fc07-4aa0-9e86-29780b7f1dc8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.074788 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c174f3a-fc07-4aa0-9e86-29780b7f1dc8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.075569 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c174f3a-fc07-4aa0-9e86-29780b7f1dc8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.076039 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2c174f3a-fc07-4aa0-9e86-29780b7f1dc8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.152456 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9a3b914a-177b-434b-adc3-9bb98027dcd2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.184791 Jan 17 02:38:22.153109 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 310/657] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:21 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:22.217072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2c174f3a-fc07-4aa0-9e86-29780b7f1dc8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.153786 Jan 17 02:38:22.221542 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 348/658] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:22 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:22.271474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:22.272365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:22.283017 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.283493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.284313 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.284752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.355073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:22.355739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:22.362758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.363215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.364534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.364534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.452404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:22.460160 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-534f1843-c60a-4f37-b0b6-f3ad682bd08b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1270 microversion: 2.1 time: 0.197407 Jan 17 02:38:22.469434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 311/659] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:22 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:22.526362 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:22.539012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-421da151-64f7-4d8d-940d-a73be445a6b7 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.187771 Jan 17 02:38:22.539947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 349/660] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:22 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:22.926165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-65e6953d-428f-4e0a-a011-2ab2e5f87ea6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:22.927887 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-65e6953d-428f-4e0a-a011-2ab2e5f87ea6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:22.938399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65e6953d-428f-4e0a-a011-2ab2e5f87ea6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.939118 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65e6953d-428f-4e0a-a011-2ab2e5f87ea6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.940458 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65e6953d-428f-4e0a-a011-2ab2e5f87ea6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:22.941369 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-65e6953d-428f-4e0a-a011-2ab2e5f87ea6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:22.973433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-65e6953d-428f-4e0a-a011-2ab2e5f87ea6 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053598 Jan 17 02:38:22.974124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 312/661] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:22 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:23.167690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cc077fd5-d0e8-4033-9e28-3c6b1d5f847f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:23.170370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cc077fd5-d0e8-4033-9e28-3c6b1d5f847f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:23.180715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc077fd5-d0e8-4033-9e28-3c6b1d5f847f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.181165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc077fd5-d0e8-4033-9e28-3c6b1d5f847f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.181943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc077fd5-d0e8-4033-9e28-3c6b1d5f847f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.182369 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cc077fd5-d0e8-4033-9e28-3c6b1d5f847f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.232504 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e4cee7c0-3967-4855-8be4-f630432dfd1b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:23.233813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e4cee7c0-3967-4855-8be4-f630432dfd1b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:23.242013 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4cee7c0-3967-4855-8be4-f630432dfd1b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.242497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4cee7c0-3967-4855-8be4-f630432dfd1b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.243262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4cee7c0-3967-4855-8be4-f630432dfd1b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.243688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4cee7c0-3967-4855-8be4-f630432dfd1b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.627373 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cc077fd5-d0e8-4033-9e28-3c6b1d5f847f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.465880 Jan 17 02:38:23.628001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 350/662] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:23 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:38:23.633241 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:23.633807 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:23.640730 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.641178 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.641934 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.642507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.670815 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:23.676547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e4cee7c0-3967-4855-8be4-f630432dfd1b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.450110 Jan 17 02:38:23.677299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 313/663] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:23 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:23.683047 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:23.683727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:23.690831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.691294 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.692102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.692568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.758736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5ffd0771-444c-4906-ad04-d764731d6480 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "DELETE /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 204 len: 0 microversion: 2.1 time: 0.128926 Jan 17 02:38:23.760125 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 351/664] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:23 2022] DELETE /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:23.764788 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:23.765481 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:23.771280 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.771732 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.773110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.773110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.838001 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:23.845571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f65c7138-60d2-4724-a990-41bcbd2e394a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.166902 Jan 17 02:38:23.846099 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 314/665] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:23 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:23.850255 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:23.850845 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:23.856580 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.857023 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.857798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.858228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.947938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:23.955328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f5136452-f561-4be0-821d-bbd891ab254d tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.194448 Jan 17 02:38:23.955895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 352/666] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:23 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:23.985508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8b70db11-c44d-4de4-a32c-72c3c5729c27 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:23.986418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8b70db11-c44d-4de4-a32c-72c3c5729c27 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:23.992612 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b70db11-c44d-4de4-a32c-72c3c5729c27 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.993347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b70db11-c44d-4de4-a32c-72c3c5729c27 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:23.994493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b70db11-c44d-4de4-a32c-72c3c5729c27 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:23.995059 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b70db11-c44d-4de4-a32c-72c3c5729c27 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.009391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:24.016673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-45b118cc-03af-4545-8c0a-9a6f078241cc tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1508 microversion: 2.1 time: 0.169636 Jan 17 02:38:24.017214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 315/667] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:23 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:24.026795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8b70db11-c44d-4de4-a32c-72c3c5729c27 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Jan 17 02:38:24.027337 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 353/668] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:23 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:38:24.643674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0e51fd1d-280b-4a35-b05c-9edc74b159c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:24.645274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0e51fd1d-280b-4a35-b05c-9edc74b159c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:24.653231 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e51fd1d-280b-4a35-b05c-9edc74b159c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.653675 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e51fd1d-280b-4a35-b05c-9edc74b159c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.654447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e51fd1d-280b-4a35-b05c-9edc74b159c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.654876 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e51fd1d-280b-4a35-b05c-9edc74b159c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.688898 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0dfe9129-75ae-4fc5-b2a0-3bc3057b10c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:24.689937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0dfe9129-75ae-4fc5-b2a0-3bc3057b10c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:24.696745 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0dfe9129-75ae-4fc5-b2a0-3bc3057b10c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.697199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0dfe9129-75ae-4fc5-b2a0-3bc3057b10c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.698013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0dfe9129-75ae-4fc5-b2a0-3bc3057b10c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.698444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0dfe9129-75ae-4fc5-b2a0-3bc3057b10c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.768406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0e51fd1d-280b-4a35-b05c-9edc74b159c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.130790 Jan 17 02:38:24.772377 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 316/669] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:24 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:24.773966 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:24.774541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:24.781897 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.782354 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.783159 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.783597 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.799925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0dfe9129-75ae-4fc5-b2a0-3bc3057b10c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.114457 Jan 17 02:38:24.800878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 354/670] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:24 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:24.863029 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:24.863792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:24.864171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lazy-loading 'services' on Instance uuid fe8714ff-adae-40c0-a96e-9b7ddfee2781 {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:24.870910 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.871356 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.872222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.872625 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.937787 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5a853f04-5c6e-4d3c-bf84-de3f1cb5ab93 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "DELETE /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781/os-volume_attachments/74c4c4e8-081e-4842-840f-26c16e01bfd9" status: 202 len: 0 microversion: 2.1 time: 0.167336 Jan 17 02:38:24.938454 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 317/671] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:38:24 2022] DELETE /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781/os-volume_attachments/74c4c4e8-081e-4842-840f-26c16e01bfd9 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:24.972466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:24.973151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:24.981368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.982090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:24.984669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:24.985356 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.039571 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:25.048218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c17fc6de-8ea8-4ea4-9727-dc0c03e1958a tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.189150 Jan 17 02:38:25.048880 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 355/672] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:24 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:25.053402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:25.054203 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:25.060551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.061004 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.061775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.062364 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.148566 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:25.156448 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3e85f3f0-bd45-4782-a456-539aa29ff132 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.187810 Jan 17 02:38:25.157321 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 318/673] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:24 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:25.161742 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2b5cd06d-9336-4f3f-acc1-5cbdbc8ec433 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:25.162697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2b5cd06d-9336-4f3f-acc1-5cbdbc8ec433 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:25.168706 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b5cd06d-9336-4f3f-acc1-5cbdbc8ec433 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.169161 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b5cd06d-9336-4f3f-acc1-5cbdbc8ec433 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.169915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b5cd06d-9336-4f3f-acc1-5cbdbc8ec433 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.170349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b5cd06d-9336-4f3f-acc1-5cbdbc8ec433 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.200628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2b5cd06d-9336-4f3f-acc1-5cbdbc8ec433 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042225 Jan 17 02:38:25.201180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 319/674] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:38:25 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:38:25.218498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:25.225873 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-632f6a84-e005-4643-9b78-845d6a0cd652 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1508 microversion: 2.1 time: 0.175793 Jan 17 02:38:25.226429 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 356/675] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:25 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:25.756211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-1bc7f814-7f21-4fae-9e49-5eec9e98397c req-652e63c0-119d-4844-a7c7-0515fc1331c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de2d50d-8380-4b0e-a6cc-598a5101eec7", "name": "network-vif-plugged", "status": "completed", "tag": "bb496404-62f2-4492-994f-87c052ecfb65"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:25.758015 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:25.758015 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:25.765740 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-1bc7f814-7f21-4fae-9e49-5eec9e98397c req-652e63c0-119d-4844-a7c7-0515fc1331c6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.766205 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-1bc7f814-7f21-4fae-9e49-5eec9e98397c req-652e63c0-119d-4844-a7c7-0515fc1331c6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.779423 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-1bc7f814-7f21-4fae-9e49-5eec9e98397c req-652e63c0-119d-4844-a7c7-0515fc1331c6 service nova] Creating event network-vif-plugged:bb496404-62f2-4492-994f-87c052ecfb65 for instance 3de2d50d-8380-4b0e-a6cc-598a5101eec7 on hv-cinder-82160 Jan 17 02:38:25.780318 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-caeaf6ac-9e3d-482b-b57a-9b09d0510085 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:25.781283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-caeaf6ac-9e3d-482b-b57a-9b09d0510085 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:25.784754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-1bc7f814-7f21-4fae-9e49-5eec9e98397c req-652e63c0-119d-4844-a7c7-0515fc1331c6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032679 Jan 17 02:38:25.785549 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 320/676] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:38:25.789553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caeaf6ac-9e3d-482b-b57a-9b09d0510085 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.790001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caeaf6ac-9e3d-482b-b57a-9b09d0510085 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.790777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caeaf6ac-9e3d-482b-b57a-9b09d0510085 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.791206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caeaf6ac-9e3d-482b-b57a-9b09d0510085 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.813007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8e1d466e-9ed3-4515-bace-2bf1eefeec35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:25.814120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8e1d466e-9ed3-4515-bace-2bf1eefeec35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:25.820950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e1d466e-9ed3-4515-bace-2bf1eefeec35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.821405 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e1d466e-9ed3-4515-bace-2bf1eefeec35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.822232 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e1d466e-9ed3-4515-bace-2bf1eefeec35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:25.822682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8e1d466e-9ed3-4515-bace-2bf1eefeec35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:25.983935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-caeaf6ac-9e3d-482b-b57a-9b09d0510085 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.206974 Jan 17 02:38:25.984906 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 357/677] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:25 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:26.001728 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8e1d466e-9ed3-4515-bace-2bf1eefeec35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.193171 Jan 17 02:38:26.003592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 321/678] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:25 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:26.065999 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:26.066692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:26.073953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.074437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.075218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.075655 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.173797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:26.174533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:26.182035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.182740 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.183620 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.184304 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.281430 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:26.289465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e62dc2e1-6e75-4cc0-a600-8db6dc810d26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.227491 Jan 17 02:38:26.290072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 358/679] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:26 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:26.294268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:26.294865 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:26.300641 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.301095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.301872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.302307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.354210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:26.361784 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a0eec428-751b-40eb-9f0d-e1b31d526321 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.192213 Jan 17 02:38:26.362353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 322/680] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:26 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:26.397961 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:26.398488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:26.405058 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.405504 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.406283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.407076 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.431719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:26.441858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:26.449373 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4e7673e5-82bf-4eb6-84dd-e9292ed525c9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1508 microversion: 2.1 time: 0.158376 Jan 17 02:38:26.449954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 359/681] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:26 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:26.511195 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-71f4e61a-2f20-4a75-b6aa-9fe7eacc3f7c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 204 len: 0 microversion: 2.1 time: 0.116504 Jan 17 02:38:26.511757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 323/682] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:26 2022] DELETE /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 17 02:38:26.519731 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:26.520362 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:26.526301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.526749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.527519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:26.527954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:26.672792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:26.680329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fa7c2a0c-95c6-4af2-a8b5-1754b33d66db tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1513 microversion: 2.1 time: 0.164272 Jan 17 02:38:26.680865 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 360/683] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:26 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:26.998056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-08af0917-3ab9-47ed-9b5b-9227b70e164b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:26.999051 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-08af0917-3ab9-47ed-9b5b-9227b70e164b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.005699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08af0917-3ab9-47ed-9b5b-9227b70e164b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.006147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08af0917-3ab9-47ed-9b5b-9227b70e164b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.006920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08af0917-3ab9-47ed-9b5b-9227b70e164b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.007351 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08af0917-3ab9-47ed-9b5b-9227b70e164b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.013689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-bee939df-b20a-4856-a8eb-603d091beff3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:27.014770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-bee939df-b20a-4856-a8eb-603d091beff3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.020986 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bee939df-b20a-4856-a8eb-603d091beff3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.021514 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bee939df-b20a-4856-a8eb-603d091beff3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.022299 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bee939df-b20a-4856-a8eb-603d091beff3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.022737 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bee939df-b20a-4856-a8eb-603d091beff3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.160554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-08af0917-3ab9-47ed-9b5b-9227b70e164b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28566 microversion: 2.20 time: 0.166194 Jan 17 02:38:27.161443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 324/684] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:26 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:27.166953 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:27.167527 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.174697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.175308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.175914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.176384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.188005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-bee939df-b20a-4856-a8eb-603d091beff3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.177750 Jan 17 02:38:27.188983 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 361/685] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:27 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:27.202937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:27.291386 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dbff349d-9a1d-40fd-902f-ff329b7a3c70 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "DELETE /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 204 len: 0 microversion: 2.1 time: 0.128120 Jan 17 02:38:27.292082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 325/686] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:27 2022] DELETE /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:27.301667 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:27.302357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.305721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:27.306418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.309062 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.309509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.310290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.310753 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.312765 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.313221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.314011 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.314435 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.509122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:27.512682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:27.517527 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7bc4f82e-639e-47a5-b3d8-31bba489f478 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.215710 Jan 17 02:38:27.518111 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 326/687] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:27 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:27.522931 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:27.523746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.524143 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ef81ddbc-678d-4b32-bca3-1c129d01d214 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1514 microversion: 2.1 time: 0.226431 Jan 17 02:38:27.525549 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 362/688] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:27 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:27.530551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:27.531153 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.537720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.538181 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.538674 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.539299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.539405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.539868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.540701 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.541259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.741771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:27.747631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:27.752280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-41c22e83-676c-48fd-92da-d8f8993e5108 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.232611 Jan 17 02:38:27.753113 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 327/689] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:27 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:27.758544 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:27.759430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:27.761161 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b601573e-e734-48be-bb1e-abf13ee1125a tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1508 microversion: 2.1 time: 0.233896 Jan 17 02:38:27.761714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 363/690] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:27 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:27.769813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.770269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.771064 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:27.771508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:27.920576 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:27.933820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-459fc3f9-204d-4d6c-a879-7fc6023d9b3a tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1513 microversion: 2.1 time: 0.179595 Jan 17 02:38:27.934388 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 328/691] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:27 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:28.173491 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6d9e71cb-90a2-4691-8dff-2b0ca3c851fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:28.177301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6d9e71cb-90a2-4691-8dff-2b0ca3c851fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:28.184460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d9e71cb-90a2-4691-8dff-2b0ca3c851fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.184903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d9e71cb-90a2-4691-8dff-2b0ca3c851fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.185680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d9e71cb-90a2-4691-8dff-2b0ca3c851fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.186108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d9e71cb-90a2-4691-8dff-2b0ca3c851fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.199353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c95262aa-bfa1-4937-a3c0-875c67f34f54 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:28.200477 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c95262aa-bfa1-4937-a3c0-875c67f34f54 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:28.207594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c95262aa-bfa1-4937-a3c0-875c67f34f54 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.208126 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c95262aa-bfa1-4937-a3c0-875c67f34f54 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.208996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c95262aa-bfa1-4937-a3c0-875c67f34f54 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.209513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c95262aa-bfa1-4937-a3c0-875c67f34f54 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.485643 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6d9e71cb-90a2-4691-8dff-2b0ca3c851fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 28787 microversion: 2.20 time: 0.315756 Jan 17 02:38:28.486530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 364/692] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:28 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 28787 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:28.536537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:28.537435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:28.546741 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.547330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.548388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.548957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.556437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c95262aa-bfa1-4937-a3c0-875c67f34f54 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.360794 Jan 17 02:38:28.557082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 329/693] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:28 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:28.561843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:28.562519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:28.569455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.569893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.570809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.571233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.735285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:28.743306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-50485391-599e-4f81-ac88-4559ee2a4b26 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.212316 Jan 17 02:38:28.743784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 365/694] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:28 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:28.759187 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:28.767013 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4c2b0294-b6a2-49ae-b2d9-33ce674bb3d1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1514 microversion: 2.1 time: 0.208867 Jan 17 02:38:28.767574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 330/695] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:28 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:28.772224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:28.772829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:28.778091 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:28.778713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:28.778824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.779231 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.780015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.780476 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.785055 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.785508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.786288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.786718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.975196 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:28.979866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:28.983095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-444e8e74-a52d-4517-a3ec-d3b30b5f2e0b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1315 microversion: 2.1 time: 0.214458 Jan 17 02:38:28.983770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 366/696] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:28 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:28.989892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:28.990024 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-38901365-ce60-4226-b9b5-6e8b0ef7d197 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1508 microversion: 2.1 time: 0.213732 Jan 17 02:38:28.990106 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:28.990203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 331/697] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:28 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:28.994719 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.995070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:28.995883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:28.996379 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.197808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:29.206144 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8ea9d1af-c75a-4d7e-ae4e-1ae545260ac0 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1513 microversion: 2.1 time: 0.221352 Jan 17 02:38:29.206823 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 367/698] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:28 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:29.499927 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-52358235-289b-4408-a09a-0210e1cfbc42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:29.501017 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-52358235-289b-4408-a09a-0210e1cfbc42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:29.507690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52358235-289b-4408-a09a-0210e1cfbc42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.508244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52358235-289b-4408-a09a-0210e1cfbc42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.509062 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52358235-289b-4408-a09a-0210e1cfbc42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.509499 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-52358235-289b-4408-a09a-0210e1cfbc42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.568750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-92a17f56-f22f-41d1-9acc-d5e9b2d88bc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:29.570525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-92a17f56-f22f-41d1-9acc-d5e9b2d88bc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:29.576358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92a17f56-f22f-41d1-9acc-d5e9b2d88bc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.576903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92a17f56-f22f-41d1-9acc-d5e9b2d88bc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.577801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92a17f56-f22f-41d1-9acc-d5e9b2d88bc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.578306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92a17f56-f22f-41d1-9acc-d5e9b2d88bc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.702805 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-52358235-289b-4408-a09a-0210e1cfbc42 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 29956 microversion: 2.20 time: 0.206468 Jan 17 02:38:29.707026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 332/699] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:29 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 29956 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:29.708393 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-f110e1d9-9088-4a9a-bfcc-d2cd30bb1921 req-7942f3a3-2411-495e-8738-1aa636f43070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48444f12-33bc-48b0-9407-d2ba0210bfae", "name": "network-vif-deleted", "tag": "4dcac35f-9d74-46b5-b915-b246173a256f"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:29.709875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:29.709875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:29.718275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f110e1d9-9088-4a9a-bfcc-d2cd30bb1921 req-7942f3a3-2411-495e-8738-1aa636f43070 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.719037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f110e1d9-9088-4a9a-bfcc-d2cd30bb1921 req-7942f3a3-2411-495e-8738-1aa636f43070 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.731559 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-f110e1d9-9088-4a9a-bfcc-d2cd30bb1921 req-7942f3a3-2411-495e-8738-1aa636f43070 service nova] Creating event network-vif-deleted:4dcac35f-9d74-46b5-b915-b246173a256f for instance 48444f12-33bc-48b0-9407-d2ba0210bfae on hv-cinder-82160 Jan 17 02:38:29.736271 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-f110e1d9-9088-4a9a-bfcc-d2cd30bb1921 req-7942f3a3-2411-495e-8738-1aa636f43070 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031509 Jan 17 02:38:29.736848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 333/700] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:29.761155 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:29.761835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:29.768741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.769221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.769994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.770420 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.852570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-92a17f56-f22f-41d1-9acc-d5e9b2d88bc3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.287336 Jan 17 02:38:29.853148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 368/701] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:29 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:38:29.857904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:29.858559 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:29.865710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.866154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.866935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:29.867467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:29.919519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:29.928308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f9b95079-a834-4185-a3c5-c7e900c13a43 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.171272 Jan 17 02:38:29.928907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 334/702] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:29 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:30.000553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:30.001155 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:30.007666 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:30.009807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.010260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.011058 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.011491 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.015043 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0459157a-bee8-49e5-8ff9-c1e1e1d08281 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1514 microversion: 2.1 time: 0.160793 Jan 17 02:38:30.015613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 369/703] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:29 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:30.019815 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:30.020432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:30.029493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.029943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.030769 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.031191 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.063967 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.064450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.064893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lazy-loading 'fault' on Instance uuid 48444f12-33bc-48b0-9407-d2ba0210bfae {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:30.107291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:30.115201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-789fe3dd-c0e2-48cd-9a29-d25d5fd59d0b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 200 len: 1312 microversion: 2.1 time: 0.098612 Jan 17 02:38:30.115744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 370/704] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:30 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:30.165216 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:30.173071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-341a2542-cae3-4fd3-9524-a238408a2a22 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1465 microversion: 2.1 time: 0.176540 Jan 17 02:38:30.173611 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 335/705] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:29 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:30.209984 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:30.210489 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:30.218280 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.218736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.219533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.219972 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.224415 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:30.225023 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:30.231071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.231508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.232325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.232760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.248342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:30.328729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-95837ca6-0555-4f3e-bd0e-70434966a39b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 204 len: 0 microversion: 2.1 time: 0.122101 Jan 17 02:38:30.329316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 371/706] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:30 2022] DELETE /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:30.337580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:30.338263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:30.343995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.344473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.345283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.345716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.363398 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:30.370813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-18b5fe01-fad6-4708-a239-c8fdffa7d0a3 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1513 microversion: 2.1 time: 0.150098 Jan 17 02:38:30.371372 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 336/707] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:30 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:30.471780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:30.480394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ecdab6c3-cecf-485c-9530-45b731d6a7d2 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1471 microversion: 2.1 time: 0.146517 Jan 17 02:38:30.480928 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 372/708] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:30 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:30.717016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-04a3600c-46d6-4d8d-bc8c-1d45a7943aea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:30.718385 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-04a3600c-46d6-4d8d-bc8c-1d45a7943aea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:30.726852 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04a3600c-46d6-4d8d-bc8c-1d45a7943aea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.727473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04a3600c-46d6-4d8d-bc8c-1d45a7943aea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.728590 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04a3600c-46d6-4d8d-bc8c-1d45a7943aea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.729187 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04a3600c-46d6-4d8d-bc8c-1d45a7943aea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.864129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-398f1577-f744-4786-9e84-93895d2c9179 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:30.865225 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-398f1577-f744-4786-9e84-93895d2c9179 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:30.871376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-398f1577-f744-4786-9e84-93895d2c9179 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.871943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-398f1577-f744-4786-9e84-93895d2c9179 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:30.872714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-398f1577-f744-4786-9e84-93895d2c9179 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:30.873215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-398f1577-f744-4786-9e84-93895d2c9179 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.180818 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-04a3600c-46d6-4d8d-bc8c-1d45a7943aea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 30776 microversion: 2.20 time: 0.468173 Jan 17 02:38:31.181916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 337/709] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:30 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 30776 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:31.189640 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:31.190764 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:31.199608 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.200060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.200902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.201341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.207606 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-398f1577-f744-4786-9e84-93895d2c9179 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 28622 microversion: 2.1 time: 0.346975 Jan 17 02:38:31.208522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 373/710] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:30 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 28622 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:31.213249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:31.213933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:31.221042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.223177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.224023 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.224500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.483439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:31.488095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:31.498443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f966f0e5-7f0c-4472-9ef9-8fd3440388a3 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.315009 Jan 17 02:38:31.498703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8cd9e76d-260a-4872-9181-b1ea5daa3b34 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1514 microversion: 2.1 time: 0.289065 Jan 17 02:38:31.499233 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 374/711] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:31 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:31.507519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 338/712] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:31 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:31.513902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:31.514718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:31.514857 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:31.515004 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 48444f12-33bc-48b0-9407-d2ba0210bfae] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:31.522957 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.523464 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.524285 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.524721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.530239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.530693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.531846 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.532308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.546193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] HTTP exception thrown: Instance 48444f12-33bc-48b0-9407-d2ba0210bfae could not be found. Jan 17 02:38:31.546786 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Returning 404 to user: Instance 48444f12-33bc-48b0-9407-d2ba0210bfae could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:38:31.547774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-93539cf9-6412-4b76-9e62-ac17203304d9 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae" status: 404 len: 111 microversion: 2.1 time: 0.038004 Jan 17 02:38:31.548374 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 375/713] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:31 2022] GET /compute/v2.1/servers/48444f12-33bc-48b0-9407-d2ba0210bfae => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:38:31.554389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:31.554389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:31.562459 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.562909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.563699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.564153 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.861123 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:31.870848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3aeddf3c-5b8b-4851-9ab9-bebc4df9b375 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1513 microversion: 2.1 time: 0.362129 Jan 17 02:38:31.871648 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 339/714] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:31 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:31.879468 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:31.887843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:31.888375 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:31.889511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-35950f8e-0659-40ad-9ec6-09073315e192 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1471 microversion: 2.1 time: 0.340041 Jan 17 02:38:31.890334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 376/715] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:31 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:31.894972 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-70bd7adf-9b44-4e9a-b0f8-61a22228e904 req-bcc429df-fce4-466f-af5c-95de9e84592c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b84647-19b2-4847-a95c-7fcff9ab436a", "name": "network-vif-unplugged", "status": "completed", "tag": "0ee354e1-38b7-4917-b74d-ad4c255e5515"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:31.896742 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:31.896742 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:38:31.897183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.899622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.900671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.901291 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.904839 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-70bd7adf-9b44-4e9a-b0f8-61a22228e904 req-bcc429df-fce4-466f-af5c-95de9e84592c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.905387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-70bd7adf-9b44-4e9a-b0f8-61a22228e904 req-bcc429df-fce4-466f-af5c-95de9e84592c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.917438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-70bd7adf-9b44-4e9a-b0f8-61a22228e904 req-bcc429df-fce4-466f-af5c-95de9e84592c service nova] Creating event network-vif-unplugged:0ee354e1-38b7-4917-b74d-ad4c255e5515 for instance f9b84647-19b2-4847-a95c-7fcff9ab436a on hv-cinder-82160 Jan 17 02:38:31.922547 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-70bd7adf-9b44-4e9a-b0f8-61a22228e904 req-bcc429df-fce4-466f-af5c-95de9e84592c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031070 Jan 17 02:38:31.923708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 377/716] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:31.928558 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:31.929485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-f8e277c0-e64b-4a2b-b8aa-b7272bf59dad req-99fd9f1c-414f-465b-8e67-e49678dc8f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8714ff-adae-40c0-a96e-9b7ddfee2781", "name": "network-vif-deleted", "tag": "bc96ff8b-35ce-4e5f-a90f-67cd4c7dc88b"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:31.931771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:31.931771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:38:31.939166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-f8e277c0-e64b-4a2b-b8aa-b7272bf59dad req-99fd9f1c-414f-465b-8e67-e49678dc8f01 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:31.939734 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-f8e277c0-e64b-4a2b-b8aa-b7272bf59dad req-99fd9f1c-414f-465b-8e67-e49678dc8f01 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:31.952054 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-f8e277c0-e64b-4a2b-b8aa-b7272bf59dad req-99fd9f1c-414f-465b-8e67-e49678dc8f01 service nova] Creating event network-vif-deleted:bc96ff8b-35ce-4e5f-a90f-67cd4c7dc88b for instance fe8714ff-adae-40c0-a96e-9b7ddfee2781 on hv-cinder-82160 Jan 17 02:38:31.957577 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-f8e277c0-e64b-4a2b-b8aa-b7272bf59dad req-99fd9f1c-414f-465b-8e67-e49678dc8f01 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Jan 17 02:38:31.958444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 378/717] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:32.021944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5614ce15-2e2f-47c5-a9e4-a18d0524cda4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "DELETE /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 204 len: 0 microversion: 2.1 time: 0.138846 Jan 17 02:38:32.022556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 340/718] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:31 2022] DELETE /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:32.031042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:32.032097 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:32.039649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.040116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.040950 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.047115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.064770 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-ba572211-1678-4326-8bae-16f8d47de8a8 req-a118042d-b502-4fea-b6e8-3be8a6ae8e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b84647-19b2-4847-a95c-7fcff9ab436a", "name": "network-vif-deleted", "tag": "0ee354e1-38b7-4917-b74d-ad4c255e5515"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:32.066639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:32.066639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:32.076145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-ba572211-1678-4326-8bae-16f8d47de8a8 req-a118042d-b502-4fea-b6e8-3be8a6ae8e98 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.076938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-ba572211-1678-4326-8bae-16f8d47de8a8 req-a118042d-b502-4fea-b6e8-3be8a6ae8e98 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.090337 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-ba572211-1678-4326-8bae-16f8d47de8a8 req-a118042d-b502-4fea-b6e8-3be8a6ae8e98 service nova] Creating event network-vif-deleted:0ee354e1-38b7-4917-b74d-ad4c255e5515 for instance f9b84647-19b2-4847-a95c-7fcff9ab436a on hv-cinder-82160 Jan 17 02:38:32.095923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-ba572211-1678-4326-8bae-16f8d47de8a8 req-a118042d-b502-4fea-b6e8-3be8a6ae8e98 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035306 Jan 17 02:38:32.096985 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 341/719] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:32.195629 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-204d9b74-f5f5-4265-a22f-e0b115e830c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:32.196739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-204d9b74-f5f5-4265-a22f-e0b115e830c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:32.198016 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:32.206233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-204d9b74-f5f5-4265-a22f-e0b115e830c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.206696 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-16011aee-0418-4a15-a485-957eb8e7a6f4 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.179291 Jan 17 02:38:32.207462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-204d9b74-f5f5-4265-a22f-e0b115e830c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.208205 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 379/720] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:32 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:32.218806 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-182d2f52-f489-4e5f-9cb1-2e45022c2c1e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:32.219781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-182d2f52-f489-4e5f-9cb1-2e45022c2c1e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:32.222453 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-204d9b74-f5f5-4265-a22f-e0b115e830c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.223303 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-204d9b74-f5f5-4265-a22f-e0b115e830c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.226441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-182d2f52-f489-4e5f-9cb1-2e45022c2c1e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.227348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-182d2f52-f489-4e5f-9cb1-2e45022c2c1e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.227682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-182d2f52-f489-4e5f-9cb1-2e45022c2c1e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.228142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-182d2f52-f489-4e5f-9cb1-2e45022c2c1e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.494971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-204d9b74-f5f5-4265-a22f-e0b115e830c2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 32022 microversion: 2.20 time: 0.303340 Jan 17 02:38:32.495691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 342/721] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:32 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 32022 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:32.514797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:32.515514 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:32.522822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.523270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.524060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.524525 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.531042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-182d2f52-f489-4e5f-9cb1-2e45022c2c1e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 29726 microversion: 2.1 time: 0.315588 Jan 17 02:38:32.532028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 380/722] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:32 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 29726 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:32.540885 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:32.541804 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:32.548899 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.549359 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.550145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.550574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.582597 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.583038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.583479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lazy-loading 'fault' on Instance uuid fe8714ff-adae-40c0-a96e-9b7ddfee2781 {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:32.637443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:32.646947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c87c14d4-46a4-465c-859d-287c43f76c28 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 200 len: 1309 microversion: 2.1 time: 0.109935 Jan 17 02:38:32.653473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 381/723] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:32 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:32.681376 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:32.688849 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c7234585-ad9a-4f2a-b69f-81adbe17c7bd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.177889 Jan 17 02:38:32.689406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 343/724] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:32 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:32.890567 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:32.891607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:32.901187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.901729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.902515 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.902945 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.906944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:32.907525 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:32.913630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.914075 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.914858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.915292 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.936105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:32.937168 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:32.937616 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lazy-loading 'fault' on Instance uuid f9b84647-19b2-4847-a95c-7fcff9ab436a {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:32.996974 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:33.004626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fca8397e-c8c4-4c00-8d73-7f7c799ad06f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 200 len: 1307 microversion: 2.1 time: 0.120229 Jan 17 02:38:33.005201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 382/725] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:32 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:33.068328 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:33.077812 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-366fe4c8-8a1f-4eda-be80-71e5a075e1a9 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1471 microversion: 2.1 time: 0.174758 Jan 17 02:38:33.078504 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 344/726] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:32 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:33.224227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:33.224791 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:33.231490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.231941 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.232756 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.233187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.369396 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:33.376982 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3db37571-e278-4a17-af0c-786e4ba64ba2 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.156530 Jan 17 02:38:33.377546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 383/727] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:33 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:33.512277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7d8897ec-dee5-489d-b47d-ffb95d4d0619 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:33.513707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7d8897ec-dee5-489d-b47d-ffb95d4d0619 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:33.524848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8897ec-dee5-489d-b47d-ffb95d4d0619 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.525449 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8897ec-dee5-489d-b47d-ffb95d4d0619 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.526228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8897ec-dee5-489d-b47d-ffb95d4d0619 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.526662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8897ec-dee5-489d-b47d-ffb95d4d0619 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.542976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7504dd12-79f9-4777-a8c0-f7cc5e09c1e1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:33.544186 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7504dd12-79f9-4777-a8c0-f7cc5e09c1e1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:33.550850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7504dd12-79f9-4777-a8c0-f7cc5e09c1e1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.551305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7504dd12-79f9-4777-a8c0-f7cc5e09c1e1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.552132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7504dd12-79f9-4777-a8c0-f7cc5e09c1e1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.553166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7504dd12-79f9-4777-a8c0-f7cc5e09c1e1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.782342 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7d8897ec-dee5-489d-b47d-ffb95d4d0619 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 32630 microversion: 2.20 time: 0.275878 Jan 17 02:38:33.783631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 345/728] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:33 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 32630 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:33.788192 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:33.788877 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: fe8714ff-adae-40c0-a96e-9b7ddfee2781] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:33.795969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.796432 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.797208 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.797634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.812845 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] HTTP exception thrown: Instance fe8714ff-adae-40c0-a96e-9b7ddfee2781 could not be found. Jan 17 02:38:33.813445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Returning 404 to user: Instance fe8714ff-adae-40c0-a96e-9b7ddfee2781 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:38:33.814297 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fe6fa32a-e722-49e3-bbcc-1887bf27623c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781" status: 404 len: 111 microversion: 2.1 time: 0.030017 Jan 17 02:38:33.815046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 346/729] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:33 2022] GET /compute/v2.1/servers/fe8714ff-adae-40c0-a96e-9b7ddfee2781 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:38:33.822403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:33.822403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:33.836213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.836771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.837906 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:33.838093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:33.944979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7504dd12-79f9-4777-a8c0-f7cc5e09c1e1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 30746 microversion: 2.1 time: 0.405631 Jan 17 02:38:33.945734 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 384/730] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:33 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 30746 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:33.993713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:34.001077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3773a705-4355-4c0a-88ef-2e76e5bdaa9c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.185268 Jan 17 02:38:34.001636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 347/731] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:33 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:34.022103 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:34.022718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: f9b84647-19b2-4847-a95c-7fcff9ab436a] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:34.029636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.030095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.030858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.031259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.047017 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] HTTP exception thrown: Instance f9b84647-19b2-4847-a95c-7fcff9ab436a could not be found. Jan 17 02:38:34.047581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Returning 404 to user: Instance f9b84647-19b2-4847-a95c-7fcff9ab436a could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:38:34.048424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dbe1c6fd-623c-4651-af9b-2a82c18c86ae tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a" status: 404 len: 111 microversion: 2.1 time: 0.030477 Jan 17 02:38:34.048944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 385/732] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:34 2022] GET /compute/v2.1/servers/f9b84647-19b2-4847-a95c-7fcff9ab436a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:38:34.094796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:34.095459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:34.101792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.102237 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.103091 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.103482 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.260624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:34.272998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2b23e2ad-b9a6-432a-a493-b4973a154c6b tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1471 microversion: 2.1 time: 0.181770 Jan 17 02:38:34.273495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 348/733] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:34 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:34.394428 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:34.395095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:34.401675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.402093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.403140 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.403567 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.794956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-39a220cc-5ef9-44b7-9af3-f10074495673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:34.796016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-39a220cc-5ef9-44b7-9af3-f10074495673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:34.802825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39a220cc-5ef9-44b7-9af3-f10074495673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.803280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39a220cc-5ef9-44b7-9af3-f10074495673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.804203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39a220cc-5ef9-44b7-9af3-f10074495673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.804638 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-39a220cc-5ef9-44b7-9af3-f10074495673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.841156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:34.848964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a6cf9536-81ff-486c-b3df-eb31fff2904b tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.459032 Jan 17 02:38:34.849562 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 386/734] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:34 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:34.961487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-74a43c3c-e70c-4052-9dde-25102716e578 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:34.962505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-74a43c3c-e70c-4052-9dde-25102716e578 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:34.985374 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74a43c3c-e70c-4052-9dde-25102716e578 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.985914 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74a43c3c-e70c-4052-9dde-25102716e578 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:34.986751 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74a43c3c-e70c-4052-9dde-25102716e578 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:34.987279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74a43c3c-e70c-4052-9dde-25102716e578 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.594848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-39a220cc-5ef9-44b7-9af3-f10074495673 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 36580 microversion: 2.20 time: 3.803395 Jan 17 02:38:38.596637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 349/735] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:34 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 36580 bytes in 3806 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:38.601728 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-bc2d5d55-e214-4b10-afdf-0591669fb3cf req-533cad4c-3af2-4904-93a2-99e2f43ca29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de2d50d-8380-4b0e-a6cc-598a5101eec7", "name": "network-vif-deleted", "tag": "bb496404-62f2-4492-994f-87c052ecfb65"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:38.603315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:38.603315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:38.611401 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-bc2d5d55-e214-4b10-afdf-0591669fb3cf req-533cad4c-3af2-4904-93a2-99e2f43ca29d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.611959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-bc2d5d55-e214-4b10-afdf-0591669fb3cf req-533cad4c-3af2-4904-93a2-99e2f43ca29d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.625574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-bc2d5d55-e214-4b10-afdf-0591669fb3cf req-533cad4c-3af2-4904-93a2-99e2f43ca29d service nova] Creating event network-vif-deleted:bb496404-62f2-4492-994f-87c052ecfb65 for instance 3de2d50d-8380-4b0e-a6cc-598a5101eec7 on hv-cinder-82160 Jan 17 02:38:38.630539 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-bc2d5d55-e214-4b10-afdf-0591669fb3cf req-533cad4c-3af2-4904-93a2-99e2f43ca29d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Jan 17 02:38:38.631592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 350/736] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:38.638452 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:38.639530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:38.647881 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.648529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.649450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.649896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.789165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:38.797112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4ad6005e-f2d4-42b1-9c54-41bef3a0c382 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.164273 Jan 17 02:38:38.797641 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 351/737] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:38 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:38.801919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:38.802628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:38.808444 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.808891 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.809662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.810084 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.840568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.841008 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.841444 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lazy-loading 'fault' on Instance uuid 3de2d50d-8380-4b0e-a6cc-598a5101eec7 {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:38.880002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff29b450a5c54e44829db14df376bf64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7e5e9c95504bb980d55c54a679de42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:38.887792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-019b5957-0de9-41c8-88aa-4a233e639975 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 200 len: 1305 microversion: 2.1 time: 0.089204 Jan 17 02:38:38.888735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 352/738] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:38 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:38.892895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:38.893506 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:38.899509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.899959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.900786 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:38.901217 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:38.916684 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-74a43c3c-e70c-4052-9dde-25102716e578 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 34887 microversion: 2.1 time: 3.962727 Jan 17 02:38:38.917546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 387/739] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:34 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 34887 bytes in 3965 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:39.045465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:39.053674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a3c80092-cfae-4777-921d-536e34fdaa16 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.163956 Jan 17 02:38:39.055049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 353/740] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:38 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:39.607812 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cd5759ff-afa5-4f61-8521-c729114e90d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:39.609181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cd5759ff-afa5-4f61-8521-c729114e90d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:39.617640 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd5759ff-afa5-4f61-8521-c729114e90d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.618219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd5759ff-afa5-4f61-8521-c729114e90d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.619319 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd5759ff-afa5-4f61-8521-c729114e90d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.619881 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cd5759ff-afa5-4f61-8521-c729114e90d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.786413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cd5759ff-afa5-4f61-8521-c729114e90d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 37586 microversion: 2.20 time: 0.182427 Jan 17 02:38:39.787555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 388/741] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:39 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 37586 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:39.814761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:39.815389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:39.822039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.822483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.823249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.823678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.905209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:39.906662 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] [instance: 3de2d50d-8380-4b0e-a6cc-598a5101eec7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:39.914359 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.914887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.915750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.916304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.931787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] HTTP exception thrown: Instance 3de2d50d-8380-4b0e-a6cc-598a5101eec7 could not be found. Jan 17 02:38:39.932477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] Returning 404 to user: Instance 3de2d50d-8380-4b0e-a6cc-598a5101eec7 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:38:39.933163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-616282cb-da4c-4dc3-bd34-c86dcaeebe48 tempest-VolumesNegativeTest-486498130 tempest-VolumesNegativeTest-486498130-project] 10.222.0.24 "GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7" status: 404 len: 111 microversion: 2.1 time: 0.032081 Jan 17 02:38:39.933718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 389/742] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:39 2022] GET /compute/v2.1/servers/3de2d50d-8380-4b0e-a6cc-598a5101eec7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:38:39.938277 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0fc6d414-e8e2-4cca-b1b9-bf1e9acb5955 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:39.939488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0fc6d414-e8e2-4cca-b1b9-bf1e9acb5955 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:39.960638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fc6d414-e8e2-4cca-b1b9-bf1e9acb5955 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.961082 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fc6d414-e8e2-4cca-b1b9-bf1e9acb5955 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.961943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fc6d414-e8e2-4cca-b1b9-bf1e9acb5955 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:39.962381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0fc6d414-e8e2-4cca-b1b9-bf1e9acb5955 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:39.967313 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:39.974754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ea92d75f-350f-4d2b-87b7-20c7a6ab8142 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.164727 Jan 17 02:38:39.975317 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 354/743] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:39 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:40.070438 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:40.071035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:40.077157 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.077598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.078348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.078778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.125446 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0fc6d414-e8e2-4cca-b1b9-bf1e9acb5955 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 35963 microversion: 2.1 time: 0.190481 Jan 17 02:38:40.126086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 390/744] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:39 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 35963 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:40.209561 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:40.217188 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dc097a54-dfe9-425a-9dfe-2cf64c3dc96c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.150331 Jan 17 02:38:40.217776 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 355/745] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:40 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:40.438973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:40.439592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:40.446767 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.447245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.448345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.448877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.475738 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:40.564461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2bd54977-258b-4166-aeb7-06e76e7ab75c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 204 len: 0 microversion: 2.1 time: 0.129529 Jan 17 02:38:40.568720 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 391/746] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:40 2022] DELETE /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:40.574053 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:40.574736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:40.588535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.588986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.591469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.592631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.745162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:40.753777 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7d88b16e-c45c-475b-9841-bd2cedf86a33 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1512 microversion: 2.1 time: 0.183853 Jan 17 02:38:40.754348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 356/747] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:40 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:40.767349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-3b9a8b44-224d-4067-8d45-d55d5ea65b70 req-0500c75f-2cbf-4c41-b457-0c639c8c1bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836aee89-f8f7-4788-8051-2d62fd7adacb", "name": "network-vif-plugged", "status": "completed", "tag": "c601475c-0c44-4ca7-a396-6569cecefedc"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:40.771034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:40.771034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:38:40.780978 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-3b9a8b44-224d-4067-8d45-d55d5ea65b70 req-0500c75f-2cbf-4c41-b457-0c639c8c1bf3 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.781771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-3b9a8b44-224d-4067-8d45-d55d5ea65b70 req-0500c75f-2cbf-4c41-b457-0c639c8c1bf3 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.796728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-3b9a8b44-224d-4067-8d45-d55d5ea65b70 req-0500c75f-2cbf-4c41-b457-0c639c8c1bf3 service nova] Creating event network-vif-plugged:c601475c-0c44-4ca7-a396-6569cecefedc for instance 836aee89-f8f7-4788-8051-2d62fd7adacb on hv-cinder-82160 Jan 17 02:38:40.801286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-13bc290c-47e3-497f-a02c-dd9af951b3b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:40.802341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-13bc290c-47e3-497f-a02c-dd9af951b3b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:40.802481 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-3b9a8b44-224d-4067-8d45-d55d5ea65b70 req-0500c75f-2cbf-4c41-b457-0c639c8c1bf3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048017 Jan 17 02:38:40.803162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 392/748] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:38:40.809714 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13bc290c-47e3-497f-a02c-dd9af951b3b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.810221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13bc290c-47e3-497f-a02c-dd9af951b3b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.811022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13bc290c-47e3-497f-a02c-dd9af951b3b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.811455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13bc290c-47e3-497f-a02c-dd9af951b3b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:40.991471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:40.992293 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:40.998843 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:40.999363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.000184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:41.000617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.141853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:41.149331 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4b2d82a6-56fd-4b9b-b3ea-922db6bc69e2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.162335 Jan 17 02:38:41.149878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 393/749] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:40 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:41.154380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-53f22454-235e-48f8-98ed-f0e1e5da7864 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:41.155310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-53f22454-235e-48f8-98ed-f0e1e5da7864 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:41.165121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53f22454-235e-48f8-98ed-f0e1e5da7864 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:41.165571 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53f22454-235e-48f8-98ed-f0e1e5da7864 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.166370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53f22454-235e-48f8-98ed-f0e1e5da7864 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:41.166797 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53f22454-235e-48f8-98ed-f0e1e5da7864 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.215508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-13bc290c-47e3-497f-a02c-dd9af951b3b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 38084 microversion: 2.20 time: 0.420325 Jan 17 02:38:41.216256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 357/750] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:40 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 38084 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:41.234074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:41.234756 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:41.242063 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:41.242511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.243279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:41.243710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.332288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-53f22454-235e-48f8-98ed-f0e1e5da7864 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 36987 microversion: 2.1 time: 0.181136 Jan 17 02:38:41.334281 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 394/751] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:41 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 36987 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:41.387806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:41.395391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-37dc1c1d-dbdc-4d14-b674-1cff9dd89dfb tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.165272 Jan 17 02:38:41.396033 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 358/752] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:41 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:41.771162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:41.771827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:41.778875 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:41.779321 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.780148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:41.780555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:41.927835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:41.935767 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-02cbe7a6-2739-4193-ad9b-e5e71383a13c tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1512 microversion: 2.1 time: 0.168645 Jan 17 02:38:41.936376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 395/753] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:41 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:42.166253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:42.166941 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:42.173786 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:42.174244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:42.175037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:42.175474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:42.226644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ba359ebe-97ef-46e0-bcb0-48222ba2fc07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:42.227565 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ba359ebe-97ef-46e0-bcb0-48222ba2fc07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:42.234183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ba359ebe-97ef-46e0-bcb0-48222ba2fc07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:42.234622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ba359ebe-97ef-46e0-bcb0-48222ba2fc07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:42.235410 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ba359ebe-97ef-46e0-bcb0-48222ba2fc07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:42.235841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ba359ebe-97ef-46e0-bcb0-48222ba2fc07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:42.318760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:42.327395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a4d7f9fe-5ed9-49e4-a8b5-a7f9554d538b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.164811 Jan 17 02:38:42.327923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 359/754] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:42 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:42.344914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e0e8b37a-f72c-41da-8ea9-6461fde4cccb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:42.345953 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e0e8b37a-f72c-41da-8ea9-6461fde4cccb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:42.352852 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0e8b37a-f72c-41da-8ea9-6461fde4cccb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:42.353307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0e8b37a-f72c-41da-8ea9-6461fde4cccb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:42.354083 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0e8b37a-f72c-41da-8ea9-6461fde4cccb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:42.354516 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0e8b37a-f72c-41da-8ea9-6461fde4cccb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:44.888762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ba359ebe-97ef-46e0-bcb0-48222ba2fc07 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 38084 microversion: 2.20 time: 2.665572 Jan 17 02:38:44.889528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 396/755] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:42 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 38084 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:38:44.894629 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:44.895406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:44.902443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:44.902892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:44.903990 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:44.904438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:44.914205 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e0e8b37a-f72c-41da-8ea9-6461fde4cccb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 38134 microversion: 2.1 time: 2.573488 Jan 17 02:38:44.914821 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 360/756] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:42 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 38134 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:44.919624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:44.920550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:44.927671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:44.928468 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:44.929260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:44.929689 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:45.132871 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:45.137522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:45.141077 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b6dd831c-217e-4759-b0c6-6a7ad80b9bde tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.250288 Jan 17 02:38:45.141676 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 397/757] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:44 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:45.145854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ee27eacb-ae88-4c58-80d2-304c78c554fa tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1512 microversion: 2.1 time: 0.229891 Jan 17 02:38:45.146259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:45.146630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 361/758] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:44 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:45.147548 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:45.153789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:45.154249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:45.155002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:45.155440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:45.290962 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:45.298550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-423220bf-5ca8-4dd6-873f-3ddf0fc4a94c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.155890 Jan 17 02:38:45.299113 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 398/759] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:45 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:45.762574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-263049129", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "networks": [{"uuid": "56a24d12-612f-4839-8346-2f43362c5e8e"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:45.814918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] validate_networks() for [('56a24d12-612f-4839-8346-2f43362c5e8e', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:38:45.900678 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d5507c1c-5249-4e4a-a51c-47d162038455 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:45.901710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d5507c1c-5249-4e4a-a51c-47d162038455 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:45.908961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5507c1c-5249-4e4a-a51c-47d162038455 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:45.909869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5507c1c-5249-4e4a-a51c-47d162038455 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:45.910647 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5507c1c-5249-4e4a-a51c-47d162038455 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:45.911233 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5507c1c-5249-4e4a-a51c-47d162038455 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.040462 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d5507c1c-5249-4e4a-a51c-47d162038455 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 38084 microversion: 2.20 time: 0.143673 Jan 17 02:38:46.041213 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 399/760] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:45 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 38084 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:46.046683 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d436e3ce-731b-412d-bc1d-225adab8908b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:46.047844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d436e3ce-731b-412d-bc1d-225adab8908b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:46.054460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d436e3ce-731b-412d-bc1d-225adab8908b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.054963 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d436e3ce-731b-412d-bc1d-225adab8908b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.055694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d436e3ce-731b-412d-bc1d-225adab8908b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.056156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d436e3ce-731b-412d-bc1d-225adab8908b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.172448 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:38:46.173007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:38:46.173483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:38:46.173885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:38:46.174317 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:38:46.183342 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.183791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.184984 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.185419 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.201866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Getting quotas for project b1b592dcedb947f490f7fe030daba362. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:38:46.205920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Getting quotas for user 859d11fc332245eabb21143a3fd4d143 and project b1b592dcedb947f490f7fe030daba362. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:38:46.216673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:38:46.218995 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:38:46.232436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d436e3ce-731b-412d-bc1d-225adab8908b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 38134 microversion: 2.1 time: 0.189659 Jan 17 02:38:46.233088 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 400/761] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:46 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 38134 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:46.237938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:46.238610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:46.247146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.247566 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.248387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.248969 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.267623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-34357066-fc4a-498c-8af0-f6d5a1c3944b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508700 Jan 17 02:38:46.268690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 362/762] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:38:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:38:46.278439 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:46.279207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:46.286509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.287092 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.287986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.288554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.499056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:46.507977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-aaaa62ef-ba4b-45ff-8cea-14be257a0884 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.273743 Jan 17 02:38:46.508611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 401/763] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:46 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:46.509658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:46.513735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1e7e9fbe-a37c-4362-bb55-b67e12c6580a tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:46.514681 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1e7e9fbe-a37c-4362-bb55-b67e12c6580a tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:46.520051 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cfd189af-2b74-4558-9fff-27a1b9b3f664 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1512 microversion: 2.1 time: 0.244003 Jan 17 02:38:46.520959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 363/764] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:46 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:46.535871 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:46.537327 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:46.550609 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.551574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.552622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:46.553129 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:46.572928 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1e7e9fbe-a37c-4362-bb55-b67e12c6580a tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:46.581055 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1e7e9fbe-a37c-4362-bb55-b67e12c6580a tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1218 microversion: 2.1 time: 0.071365 Jan 17 02:38:46.582052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 402/765] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:46 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:46.716598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:46.724567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d1d43211-df41-4978-9663-bcb606dedfde tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.200930 Jan 17 02:38:46.725159 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 364/766] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:46 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:47.052305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a5941b8f-7da5-4431-8179-0aebfbfc3c89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:47.053583 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a5941b8f-7da5-4431-8179-0aebfbfc3c89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:47.062317 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5941b8f-7da5-4431-8179-0aebfbfc3c89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.062766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5941b8f-7da5-4431-8179-0aebfbfc3c89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.063550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5941b8f-7da5-4431-8179-0aebfbfc3c89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.063964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a5941b8f-7da5-4431-8179-0aebfbfc3c89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.221463 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a5941b8f-7da5-4431-8179-0aebfbfc3c89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 38219 microversion: 2.20 time: 0.172400 Jan 17 02:38:47.222525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 403/767] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:47 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 38219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:47.244611 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-231add97-2e4d-49e5-a747-2439f1e6c404 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:47.245631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-231add97-2e4d-49e5-a747-2439f1e6c404 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:47.252270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-231add97-2e4d-49e5-a747-2439f1e6c404 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.252718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-231add97-2e4d-49e5-a747-2439f1e6c404 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.253492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-231add97-2e4d-49e5-a747-2439f1e6c404 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.253926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-231add97-2e4d-49e5-a747-2439f1e6c404 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.532150 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:47.533204 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:47.539997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-231add97-2e4d-49e5-a747-2439f1e6c404 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 200 len: 38263 microversion: 2.1 time: 0.298513 Jan 17 02:38:47.541571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 365/768] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:38:47 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 38263 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:47.544529 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.544974 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.545726 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.546188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.547148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:47.548098 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:47.554847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.555306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.556090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.556519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.741218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:47.744346 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:47.749335 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4e92a4a9-af63-40b9-b3bb-91868e1b27d5 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.224810 Jan 17 02:38:47.750123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 404/769] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:47 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:47.752060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fdbb9832-4b5b-4c84-ac67-f017fbf6e743 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1512 microversion: 2.1 time: 0.209379 Jan 17 02:38:47.753780 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 366/770] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:47 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:47.754220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3a17a9bd-ad6a-4ca2-8b91-accd6cd183ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:47.754722 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3a17a9bd-ad6a-4ca2-8b91-accd6cd183ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:47.758344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:47.758911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:47.763700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a17a9bd-ad6a-4ca2-8b91-accd6cd183ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.764184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a17a9bd-ad6a-4ca2-8b91-accd6cd183ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.765011 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a17a9bd-ad6a-4ca2-8b91-accd6cd183ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.765431 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a17a9bd-ad6a-4ca2-8b91-accd6cd183ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.766789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.767235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.767977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.768445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.789311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3a17a9bd-ad6a-4ca2-8b91-accd6cd183ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/ips" status: 200 len: 146 microversion: 2.1 time: 0.038269 Jan 17 02:38:47.789771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 405/771] 10.222.0.24 () {58 vars in 1247 bytes} [Mon Jan 17 02:38:47 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:47.793887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:47.794486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:47.800637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.801093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.801873 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:47.802308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:47.828734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:47.836499 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-785447b0-bee4-49ed-b85c-c207fca54fd1 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1270 microversion: 2.1 time: 0.082845 Jan 17 02:38:47.837277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 367/772] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:47 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:47.944201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:47.952850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c7e7b32c-ad65-44a0-8173-59e89eb59576 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1258 microversion: 2.1 time: 0.162124 Jan 17 02:38:47.953415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 406/773] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:47 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:48.236925 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3b083049-875a-4bcc-9f28-5555168d4a21 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:48.237885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3b083049-875a-4bcc-9f28-5555168d4a21 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:48.248277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b083049-875a-4bcc-9f28-5555168d4a21 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.248822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b083049-875a-4bcc-9f28-5555168d4a21 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.249517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b083049-875a-4bcc-9f28-5555168d4a21 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.249953 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b083049-875a-4bcc-9f28-5555168d4a21 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.386200 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3b083049-875a-4bcc-9f28-5555168d4a21 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 200 len: 38227 microversion: 2.20 time: 0.152671 Jan 17 02:38:48.386928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 368/774] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:48 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 38227 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:38:48.398910 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3a5cd358-9f28-4e24-9d93-d88409e9709d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:48.399693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3a5cd358-9f28-4e24-9d93-d88409e9709d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:48.406575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a5cd358-9f28-4e24-9d93-d88409e9709d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.407165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a5cd358-9f28-4e24-9d93-d88409e9709d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.408050 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a5cd358-9f28-4e24-9d93-d88409e9709d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.408775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3a5cd358-9f28-4e24-9d93-d88409e9709d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.435404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3a5cd358-9f28-4e24-9d93-d88409e9709d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/ips" status: 200 len: 152 microversion: 2.20 time: 0.040120 Jan 17 02:38:48.436007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 407/775] 10.222.0.24 () {60 vars in 1288 bytes} [Mon Jan 17 02:38:48 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:38:48.661742 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-f86127f0-0123-4a0f-823d-2d4cbebec489 req-cf8f29cf-69d3-47b8-b6f6-878b70dd7333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d204d6-b0f5-4ea5-932d-9cdbd447c999", "name": "network-vif-deleted", "tag": "45342282-34ed-4c54-b481-93d32f1a0ecf"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:48.663896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:48.663896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:48.672988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f86127f0-0123-4a0f-823d-2d4cbebec489 req-cf8f29cf-69d3-47b8-b6f6-878b70dd7333 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.673760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f86127f0-0123-4a0f-823d-2d4cbebec489 req-cf8f29cf-69d3-47b8-b6f6-878b70dd7333 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.687617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-f86127f0-0123-4a0f-823d-2d4cbebec489 req-cf8f29cf-69d3-47b8-b6f6-878b70dd7333 service nova] Creating event network-vif-deleted:45342282-34ed-4c54-b481-93d32f1a0ecf for instance a8d204d6-b0f5-4ea5-932d-9cdbd447c999 on hv-cinder-82160 Jan 17 02:38:48.693841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-f86127f0-0123-4a0f-823d-2d4cbebec489 req-cf8f29cf-69d3-47b8-b6f6-878b70dd7333 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036417 Jan 17 02:38:48.695238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 369/776] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:48.769747 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:48.770251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:48.772100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:48.772938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:48.779571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.780742 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.782430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.782549 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.783009 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.783873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.784263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.784891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.916965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:48.931230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c91672f9-547b-4411-b4d8-a1a9c54c760e tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 200 len: 1302 microversion: 2.1 time: 0.165370 Jan 17 02:38:48.933198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 370/777] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:48 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 1302 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:48.940868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:48.942121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:48.951418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.952103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:48.952986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:48.953455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.001903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:49.011595 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5b936f5c-f2ec-41c4-acb9-104fcb17a62c tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.247281 Jan 17 02:38:49.012091 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 408/778] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:48 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:49.021948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:49.021948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:49.038272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.038955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.039937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.040580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.187229 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:49.198795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3e987b75-1f17-412e-bcfd-ff11b7461cb9 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.264080 Jan 17 02:38:49.199722 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 371/779] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:48 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:49.241052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:49.251008 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e7734860-898c-453a-bbd8-705d32685db2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1442 microversion: 2.1 time: 0.237446 Jan 17 02:38:49.252575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 409/780] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:49 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1442 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:49.269366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:49.270934 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:49.277887 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.278431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.279206 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.279779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.464530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:49.473101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cb2c2aad-e1db-41fe-ac32-a4fce687ac87 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1442 microversion: 2.1 time: 0.209047 Jan 17 02:38:49.473765 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 372/781] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:49 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1442 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:49.731177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-dcb7b5cd-8ed0-47d7-9459-e74b78b6abee req-0b85a276-9ed2-43f8-b752-bb196b236825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0fc10a-49d6-4039-9d8b-2dc4183b54b7", "tag": "8621d1fb-d919-4954-b511-5c85c9126b23"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:49.732951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:49.732951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:38:49.740896 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-dcb7b5cd-8ed0-47d7-9459-e74b78b6abee req-0b85a276-9ed2-43f8-b752-bb196b236825 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.741541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-dcb7b5cd-8ed0-47d7-9459-e74b78b6abee req-0b85a276-9ed2-43f8-b752-bb196b236825 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.758682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-dcb7b5cd-8ed0-47d7-9459-e74b78b6abee req-0b85a276-9ed2-43f8-b752-bb196b236825 service nova] Creating event network-changed:8621d1fb-d919-4954-b511-5c85c9126b23 for instance 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 on hv-cinder-82160 Jan 17 02:38:49.763609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-dcb7b5cd-8ed0-47d7-9459-e74b78b6abee req-0b85a276-9ed2-43f8-b752-bb196b236825 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036132 Jan 17 02:38:49.764235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 410/782] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:49.948486 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:49.949124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: a8d204d6-b0f5-4ea5-932d-9cdbd447c999] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:49.955812 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.956531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.957432 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.958069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.973093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] HTTP exception thrown: Instance a8d204d6-b0f5-4ea5-932d-9cdbd447c999 could not be found. Jan 17 02:38:49.973977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Returning 404 to user: Instance a8d204d6-b0f5-4ea5-932d-9cdbd447c999 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:38:49.974977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6e9ce583-4128-4c3e-9d70-a11e77a6d449 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999" status: 404 len: 111 microversion: 2.1 time: 0.030259 Jan 17 02:38:49.975681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 373/783] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:49 2022] GET /compute/v2.1/servers/a8d204d6-b0f5-4ea5-932d-9cdbd447c999 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:38:49.984938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:49.985552 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:49.991651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.992210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:49.992976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:49.993427 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:50.018774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:50.028899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:50.029862 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:50.037190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:50.038003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:50.038969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:50.039560 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:50.111645 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-34f2cc25-52ae-4920-9ff6-c36fdd0fcc64 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 204 len: 0 microversion: 2.1 time: 0.131047 Jan 17 02:38:50.112663 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 411/784] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:49 2022] DELETE /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:50.122727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:50.123856 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:50.130422 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:50.131053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:50.132084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:50.132726 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:50.311175 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:50.318975 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cffac970-2035-4493-832e-5670a4771a24 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.294379 Jan 17 02:38:50.319584 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 374/785] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:50 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:50.334637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:50.335252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:50.341482 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:50.341923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:50.342724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:50.343153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:50.516013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:50.525347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b16918c8-f829-4bcd-b0fa-29be6707df08 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1512 microversion: 2.1 time: 0.407984 Jan 17 02:38:50.526073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 412/786] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:50 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:50.630625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:50.638558 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fdc706bc-a7c6-470e-9c1e-936316d18ae3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.312044 Jan 17 02:38:50.639091 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 375/787] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:50 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:51.336013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:51.336592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:51.343278 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.343723 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:51.344531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.344960 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:51.523106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0fe890b2-c046-4485-a378-4c4897fa7d08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c7a9b37-113f-4e1d-bb9f-078720704735"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:51.524341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0fe890b2-c046-4485-a378-4c4897fa7d08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:51.533166 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0fe890b2-c046-4485-a378-4c4897fa7d08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.533875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0fe890b2-c046-4485-a378-4c4897fa7d08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:51.535523 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0fe890b2-c046-4485-a378-4c4897fa7d08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.536715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0fe890b2-c046-4485-a378-4c4897fa7d08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:51.733961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:51.742646 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e4a42bb6-034a-49e3-82c1-6c5975afd773 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1521 microversion: 2.1 time: 0.410301 Jan 17 02:38:51.753035 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 413/788] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:51 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:51.757973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:51.758794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:51.765512 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.766010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:51.766757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.767191 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:51.832640 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0fe890b2-c046-4485-a378-4c4897fa7d08 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313285 Jan 17 02:38:51.833540 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 376/789] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:38:51 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:38:51.846138 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:51.846867 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:51.860957 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.861403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:51.862204 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:51.862656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.178677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:52.186655 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1a6b52b3-f74b-4d4e-945b-810578ec28bc tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1512 microversion: 2.1 time: 0.432210 Jan 17 02:38:52.187709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 414/790] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:51 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:52.192450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-0520c924-9953-45fc-b9ad-a38d1d181b1a req-67a6853e-2d6e-4f76-9cdc-9b31133e5eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ef95ec-9461-446c-ac23-d29814c0a4fa", "name": "network-vif-deleted", "tag": "7ed6ad5d-11bb-4292-b0e7-ddace74a6459"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:52.194314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:52.194314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:38:52.201615 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-0520c924-9953-45fc-b9ad-a38d1d181b1a req-67a6853e-2d6e-4f76-9cdc-9b31133e5eef service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.202163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-0520c924-9953-45fc-b9ad-a38d1d181b1a req-67a6853e-2d6e-4f76-9cdc-9b31133e5eef service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.213491 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-0520c924-9953-45fc-b9ad-a38d1d181b1a req-67a6853e-2d6e-4f76-9cdc-9b31133e5eef service nova] Creating event network-vif-deleted:7ed6ad5d-11bb-4292-b0e7-ddace74a6459 for instance 24ef95ec-9461-446c-ac23-d29814c0a4fa on hv-cinder-82160 Jan 17 02:38:52.218386 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-0520c924-9953-45fc-b9ad-a38d1d181b1a req-67a6853e-2d6e-4f76-9cdc-9b31133e5eef service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029224 Jan 17 02:38:52.218979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 415/791] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:52.223951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:52.224553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:52.230477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.230926 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.231723 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.232193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.245979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:52.257054 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lazy-loading 'flavor' on Instance uuid d7e3840c-9200-4dfe-8879-42d7cd878ec1 {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:52.257264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3749213e-0b85-4222-8256-7c3350da77b2 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.421907 Jan 17 02:38:52.257769 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 377/792] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:51 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:52.527414 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-55d9b0dc-a245-47ab-831f-76714d96ec3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 202 len: 0 microversion: 2.20 time: 0.307026 Jan 17 02:38:52.528002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 416/793] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:38:52 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:52.538318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:52.538981 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:52.545872 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.546395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.547321 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.547760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.692274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:52.700860 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:52.702360 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:52.703692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0328825d-7a55-4bc2-9761-fe2f2bc1a2b1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.170097 Jan 17 02:38:52.704835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 378/794] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:38:52 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:38:52.760330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:52.761007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:52.767258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.767702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.768496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.768925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.798760 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:52.799198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:52.799826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lazy-loading 'fault' on Instance uuid 24ef95ec-9461-446c-ac23-d29814c0a4fa {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:38:52.846829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1194d9f76740759a66514895eaf550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21140fd2fa314c1abcf9aa4f51d2984e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:52.854187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5f393b94-436b-49bd-bcae-a36a226f4d97 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 200 len: 1311 microversion: 2.1 time: 0.097957 Jan 17 02:38:52.854758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 417/795] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:52 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:53.203453 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:53.204230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:53.210690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.211255 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.212347 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.212893 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.274024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:53.274658 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:53.280770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.281608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.282395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.283093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.493023 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:53.501349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c27f47b8-1e92-4636-905b-fabc3fde1a26 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 200 len: 1512 microversion: 2.1 time: 0.301633 Jan 17 02:38:53.510623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 379/796] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:53 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:53.554003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:53.561710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cb6f77a4-422e-4c10-987a-4565e6d17a94 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.291505 Jan 17 02:38:53.562295 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 418/797] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:53 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:53.722642 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:53.723264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:53.730227 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.731375 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.732172 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.732767 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.865268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:53.870708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:53.871315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] [instance: 24ef95ec-9461-446c-ac23-d29814c0a4fa] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:53.873112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:53.874598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:53.875727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b7af5a94-2c36-4ff5-a5a4-4040ced86875 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.157041 Jan 17 02:38:53.876530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 380/798] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:38:53 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:38:53.877337 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.877800 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.878585 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:53.879021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:53.892593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] HTTP exception thrown: Instance 24ef95ec-9461-446c-ac23-d29814c0a4fa could not be found. Jan 17 02:38:53.893181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] Returning 404 to user: Instance 24ef95ec-9461-446c-ac23-d29814c0a4fa could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:38:53.894014 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fa04710e-96df-485c-bbc7-e9ed25edad87 tempest-ServerRescueNegativeTestJSON-2085620746 tempest-ServerRescueNegativeTestJSON-2085620746-project] 10.222.0.24 "GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa" status: 404 len: 111 microversion: 2.1 time: 0.026937 Jan 17 02:38:53.894543 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 419/799] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:53 2022] GET /compute/v2.1/servers/24ef95ec-9461-446c-ac23-d29814c0a4fa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 02:38:54.236490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-c732da99-1cc2-4007-80bb-074cde14774f req-67bc8e1c-b2a1-4dad-8a98-cc44b70df47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836aee89-f8f7-4788-8051-2d62fd7adacb", "tag": "c601475c-0c44-4ca7-a396-6569cecefedc"}, {"server_uuid": "7ccc6201-bf7b-4df8-bfc9-690b142202ee", "name": "network-vif-deleted", "tag": "30e2dec1-14b3-4bc2-85e9-ce1f7d687cd2"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:54.238201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:54.238201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:54.247268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-c732da99-1cc2-4007-80bb-074cde14774f req-67bc8e1c-b2a1-4dad-8a98-cc44b70df47c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:54.247700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-c732da99-1cc2-4007-80bb-074cde14774f req-67bc8e1c-b2a1-4dad-8a98-cc44b70df47c service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:54.261228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-c732da99-1cc2-4007-80bb-074cde14774f req-67bc8e1c-b2a1-4dad-8a98-cc44b70df47c service nova] Creating event network-changed:c601475c-0c44-4ca7-a396-6569cecefedc for instance 836aee89-f8f7-4788-8051-2d62fd7adacb on hv-cinder-82160 Jan 17 02:38:54.261724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-c732da99-1cc2-4007-80bb-074cde14774f req-67bc8e1c-b2a1-4dad-8a98-cc44b70df47c service nova] Creating event network-vif-deleted:30e2dec1-14b3-4bc2-85e9-ce1f7d687cd2 for instance 7ccc6201-bf7b-4df8-bfc9-690b142202ee on hv-cinder-82160 Jan 17 02:38:54.270843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-c732da99-1cc2-4007-80bb-074cde14774f req-67bc8e1c-b2a1-4dad-8a98-cc44b70df47c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037906 Jan 17 02:38:54.271430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 381/800] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:54.519056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:54.519056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 7ccc6201-bf7b-4df8-bfc9-690b142202ee] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:54.526735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:54.527502 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:54.528715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:54.529301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:54.543849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] HTTP exception thrown: Instance 7ccc6201-bf7b-4df8-bfc9-690b142202ee could not be found. Jan 17 02:38:54.544485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Returning 404 to user: Instance 7ccc6201-bf7b-4df8-bfc9-690b142202ee could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:38:54.545326 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-090d1dd1-f912-4d50-a625-db15e4143848 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee" status: 404 len: 111 microversion: 2.1 time: 0.030648 Jan 17 02:38:54.545905 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 420/801] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:54 2022] GET /compute/v2.1/servers/7ccc6201-bf7b-4df8-bfc9-690b142202ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:38:54.580002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:54.580826 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:54.586971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:54.587429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:54.588261 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:54.588716 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:54.894996 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:54.896988 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:54.904655 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:54.905443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:54.906635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:54.907189 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:54.975083 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:54.982619 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ad8762b7-99f2-4c76-9c39-6cf617bd4a0e tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.407319 Jan 17 02:38:54.983199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 382/802] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:54 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:55.224102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:55.232421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:55.233893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:55.235138 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cf4f265d-a1aa-40de-8953-f57a0098e44d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.344054 Jan 17 02:38:55.235699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 421/803] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:38:54 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:38:55.690930 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:55.691485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:55.698573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:55.699019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:55.700031 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:55.700498 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:55.726769 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:38:55.803926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1388bf56-3b38-4412-ace7-3d9b290f4f5b tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 204 len: 0 microversion: 2.1 time: 0.116793 Jan 17 02:38:55.804908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 383/804] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:38:55 2022] DELETE /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:38:55.814137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:55.814755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:55.821226 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:55.821679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:55.822467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:55.822903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:55.999512 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:56.000211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:56.006223 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:56.006669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:56.007441 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:56.007870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:56.082376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:56.091314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-173ecee7-f452-4646-80d8-7e708f1a3c06 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1513 microversion: 2.1 time: 0.282006 Jan 17 02:38:56.092410 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 422/805] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:55 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:56.230513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:56.238384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c2465ac9-6961-42cb-8132-92b3f183cee3 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.243007 Jan 17 02:38:56.238929 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 384/806] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:55 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:56.253376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:56.254037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:56.260367 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:56.260815 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:56.261582 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:56.262018 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:56.438937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:56.447819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:56.449356 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:56.450563 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8e352874-773e-4f17-9d60-522727bf2c78 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.200965 Jan 17 02:38:56.460353 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 423/807] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:38:56 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:38:56.849334 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-39da9641-423e-4ddd-acee-20e08457479e req-fbf9cf02-8d92-48c6-aedc-b19b0686f2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0fc10a-49d6-4039-9d8b-2dc4183b54b7", "name": "network-vif-plugged", "status": "completed", "tag": "8621d1fb-d919-4954-b511-5c85c9126b23"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:56.852853 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:56.852853 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:56.864021 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-39da9641-423e-4ddd-acee-20e08457479e req-fbf9cf02-8d92-48c6-aedc-b19b0686f2a6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:56.864832 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-39da9641-423e-4ddd-acee-20e08457479e req-fbf9cf02-8d92-48c6-aedc-b19b0686f2a6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:56.881427 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-39da9641-423e-4ddd-acee-20e08457479e req-fbf9cf02-8d92-48c6-aedc-b19b0686f2a6 service nova] Creating event network-vif-plugged:8621d1fb-d919-4954-b511-5c85c9126b23 for instance 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 on hv-cinder-82160 Jan 17 02:38:56.891434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-39da9641-423e-4ddd-acee-20e08457479e req-fbf9cf02-8d92-48c6-aedc-b19b0686f2a6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048334 Jan 17 02:38:56.893176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 385/808] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:57.108518 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:57.109102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:57.118886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:57.119391 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:57.120227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:57.120829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:57.255021 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:57.256372 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:57.262752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:57.263598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:57.264626 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:57.265220 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:57.305350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:57.313210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2f485cea-61e1-4ea7-a6e7-f7ea0a10380f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1513 microversion: 2.1 time: 0.208361 Jan 17 02:38:57.325295 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 424/809] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:57 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:57.436660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:57.444200 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a6a5e416-e864-46ba-b2f0-47c6415fe31b tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.193132 Jan 17 02:38:57.444813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 386/810] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:57 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:38:57.468698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:57.469348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:57.475165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:57.475603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:57.476395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:57.476825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:57.604609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:57.612599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:57.614082 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:57.615268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-92150f47-126c-40ca-9ff0-5dbc239a4b46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.150333 Jan 17 02:38:57.615833 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 425/811] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:38:57 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:38:58.332624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:58.333232 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:58.339418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:58.339873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:58.340751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:58.341203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:58.460883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:58.461853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:58.468310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:58.468766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:58.469556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:58.470279 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:58.472698 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:58.480391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-524ca231-0a18-41c8-975c-058961bb629f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1513 microversion: 2.1 time: 0.151399 Jan 17 02:38:58.481203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 387/812] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:58 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:58.634562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:58.634680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:58.635122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:58.642385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b34fc6b6-58c7-4ff6-b7b8-488960f5a3cd tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1318 microversion: 2.1 time: 0.185084 Jan 17 02:38:58.643201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 426/813] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:58 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:58.649293 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:58.649748 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:58.650549 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:58.650983 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:58.783464 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:58.791639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:58.793146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:58.794343 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-32aaf3e6-1dbc-49b5-9ba2-2641ba25dabc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.164380 Jan 17 02:38:58.794885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 388/814] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:38:58 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:38:58.913485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0a6b171e-8a25-4fe3-9972-1ce38e0e93f2 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Action: 'create', calling method: .version_select at 0x7f074e67c3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2085196055"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:59.194271 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0a6b171e-8a25-4fe3-9972-1ce38e0e93f2 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.414447 Jan 17 02:38:59.200624 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 427/815] 10.222.0.24 () {60 vars in 1154 bytes} [Mon Jan 17 02:38:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 416 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 17 02:38:59.208847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1a6ea9f8-b7f4-4748-b391-c97e65108c63 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074de078b0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:59.268127 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1a6ea9f8-b7f4-4748-b391-c97e65108c63 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 200 len: 345 microversion: 2.1 time: 0.065358 Jan 17 02:38:59.273429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 389/816] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:38:59 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:59.497057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:59.498357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:59.505924 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.508845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.509539 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.510056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.602297 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19dac2ccdf34b62bf4dc5b43c034648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c889c4e9bfb24231968d2c8e2d02a1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:59.610031 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6251592f-3e07-4493-8a24-29be66201f72 tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 200 len: 1471 microversion: 2.1 time: 0.117179 Jan 17 02:38:59.610593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 428/817] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:59 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 1471 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:59.634907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-ab11a867-b44b-43fe-993a-7183ac92c1fb req-b350ff9b-c916-4b49-8957-f97d4581d3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ede7e90-f5c5-49ed-9e17-ed43a35b8d41", "name": "network-vif-deleted", "tag": "7b3a5764-34ba-43e6-9b3f-7d34a124a296"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:59.636668 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:38:59.636668 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:38:59.644609 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-ab11a867-b44b-43fe-993a-7183ac92c1fb req-b350ff9b-c916-4b49-8957-f97d4581d3e7 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.645086 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-ab11a867-b44b-43fe-993a-7183ac92c1fb req-b350ff9b-c916-4b49-8957-f97d4581d3e7 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.655249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-ab11a867-b44b-43fe-993a-7183ac92c1fb req-b350ff9b-c916-4b49-8957-f97d4581d3e7 service nova] Creating event network-vif-deleted:7b3a5764-34ba-43e6-9b3f-7d34a124a296 for instance 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 on hv-cinder-82160 Jan 17 02:38:59.659234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:59.659784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:59.660492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-ab11a867-b44b-43fe-993a-7183ac92c1fb req-b350ff9b-c916-4b49-8957-f97d4581d3e7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029632 Jan 17 02:38:59.661087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 390/818] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:38:59.666238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.666696 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.667477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.667925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.798948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:59.806582 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e7ae0085-261a-4d8f-854b-e82fab134df7 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1508 microversion: 2.1 time: 0.151439 Jan 17 02:38:59.807138 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 429/819] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:38:59 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:38:59.812834 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:38:59.813598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:59.819769 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.820350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.821213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.821698 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.822908 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-90e3662b-5c22-4421-9c61-bf16d49132be tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67717b91-6e4f-4592-a0f9-1e58577a6945", "device": "/dev/sdb"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:38:59.824035 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-90e3662b-5c22-4421-9c61-bf16d49132be tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:38:59.830388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90e3662b-5c22-4421-9c61-bf16d49132be tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.830864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90e3662b-5c22-4421-9c61-bf16d49132be tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.831648 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90e3662b-5c22-4421-9c61-bf16d49132be tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:38:59.832089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90e3662b-5c22-4421-9c61-bf16d49132be tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:38:59.953645 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:59.961636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:59.963121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:38:59.964289 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6ecb5549-d644-4a84-823a-6d0d31dd841e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.155396 Jan 17 02:38:59.964855 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 391/820] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:38:59 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:00.080046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-90e3662b-5c22-4421-9c61-bf16d49132be tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "POST /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260816 Jan 17 02:39:00.080740 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 430/821] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:38:59 2022] POST /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:39:00.280638 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f4274bb6-b3ec-47cd-ab6d-055191fd80d5 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dd66ca0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:00.328178 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f4274bb6-b3ec-47cd-ab6d-055191fd80d5 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 200 len: 346 microversion: 2.1 time: 0.051265 Jan 17 02:39:00.340823 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 392/822] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:00 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:00.343329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dee32ca9-28ad-4d71-b841-4f386d1c3e2b tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Action: 'create', calling method: .version_select at 0x7f074e705e50>, body: {"snapshot": {"volume_id": "634f85b7-dee7-487b-9a71-51f0496effdb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1375726029"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:00.518308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dee32ca9-28ad-4d71-b841-4f386d1c3e2b tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.180406 Jan 17 02:39:00.519031 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 431/823] 10.222.0.24 () {60 vars in 1161 bytes} [Mon Jan 17 02:39:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:00.529707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-68346d62-56e2-4b63-b60a-7cfe8537b25d tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f0753086d30>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:00.579116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-76377a20-0b20-4c5d-a48d-984ce5d5eb31 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:00.583724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-68346d62-56e2-4b63-b60a-7cfe8537b25d tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.058509 Jan 17 02:39:00.584339 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 393/824] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:00 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:00.589272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76377a20-0b20-4c5d-a48d-984ce5d5eb31 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:00.589899 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-76377a20-0b20-4c5d-a48d-984ce5d5eb31 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:00.594157 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-41aef2b9-6413-4ff8-ade7-3a989dcc00a5 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f075308d160>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:00.624469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-41aef2b9-6413-4ff8-ade7-3a989dcc00a5 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033942 Jan 17 02:39:00.625050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 394/825] 10.222.0.24 () {58 vars in 1139 bytes} [Mon Jan 17 02:39:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:00.629577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:00.630185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] [instance: 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:00.636684 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:00.637249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:00.637944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:00.638365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:00.649620 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-76377a20-0b20-4c5d-a48d-984ce5d5eb31 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Going to try to stop instance {{(pid=122781) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 17 02:39:00.651239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] HTTP exception thrown: Instance 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 could not be found. Jan 17 02:39:00.651807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] Returning 404 to user: Instance 5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:39:00.652636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6ffcf45f-3586-4c18-a793-15ce0bad0c0f tempest-AttachVolumeNegativeTest-1665902240 tempest-AttachVolumeNegativeTest-1665902240-project] 10.222.0.24 "GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41" status: 404 len: 111 microversion: 2.1 time: 0.026575 Jan 17 02:39:00.653202 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 395/826] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:00 2022] GET /compute/v2.1/servers/5ede7e90-f5c5-49ed-9e17-ed43a35b8d41 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:39:00.657834 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-638c731b-dc9c-4921-a1b2-4f5c4e6772de tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dd4bee0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:00.693042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-638c731b-dc9c-4921-a1b2-4f5c4e6772de tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.038779 Jan 17 02:39:00.693554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 396/827] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:00 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:00.697358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-76377a20-0b20-4c5d-a48d-984ce5d5eb31 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 202 len: 0 microversion: 2.1 time: 0.121078 Jan 17 02:39:00.700452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 432/828] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:39:00 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:39:00.704057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:00.704828 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:00.710949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:00.711397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:00.712211 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:00.712665 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:00.855833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:00.866666 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a509d99a-99b5-4113-a79a-629c8220a6be tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.166089 Jan 17 02:39:00.867463 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 397/829] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:00 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:00.983764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:00.984621 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:00.991946 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:00.992393 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:00.993231 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:00.993675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:01.136405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:01.145934 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:01.147448 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:01.148822 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-51e771d2-a9a9-49ce-b662-34b00dccc794 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.169402 Jan 17 02:39:01.149553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 433/830] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:00 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:01.705635 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-27fe0f7b-834a-442b-b148-eb0115c103e6 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dd8f310>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:01.752605 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-27fe0f7b-834a-442b-b148-eb0115c103e6 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.050968 Jan 17 02:39:01.753265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 398/831] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:01 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:01.884454 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:01.885617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:01.892180 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:01.892599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:01.893578 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:01.894016 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:02.032038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:02.039966 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-bb533baa-577e-4058-9992-fe5c6c752f56 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.159245 Jan 17 02:39:02.040559 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 434/832] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:01 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:02.168296 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:02.168896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:02.175188 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:02.175712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:02.176534 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:02.176967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:02.314832 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:02.322844 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:02.324373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:02.325621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f95e8492-e762-4c37-9b5f-70cc86bf398b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.161134 Jan 17 02:39:02.326143 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 399/833] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:02 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:02.764602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d2e2e131-1e13-42be-babb-b8ba564ff484 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074e705ca0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:02.794993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d2e2e131-1e13-42be-babb-b8ba564ff484 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.032890 Jan 17 02:39:02.795788 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 435/834] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:02 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:03.056407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:03.056998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:03.063495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:03.063967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:03.064750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:03.065173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:03.196664 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:03.204741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ad8c3856-5afe-4037-8018-62ab8642cb81 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.151971 Jan 17 02:39:03.205414 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 400/835] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:03 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:03.344421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:03.345024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:03.351339 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:03.351797 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:03.352731 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:03.353049 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:03.489817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:03.497902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:03.499425 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:03.500615 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-696d79c5-34b4-441f-bddb-8e8076064b98 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.160675 Jan 17 02:39:03.501179 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 436/836] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:03 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:03.812507 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4dd68784-aa1e-42d4-8faf-0890ad279d5e tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dd4bee0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:03.846031 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4dd68784-aa1e-42d4-8faf-0890ad279d5e tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.040385 Jan 17 02:39:03.846606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 401/837] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:03 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:04.225823 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:04.226776 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:04.236981 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:04.237744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:04.238951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:04.239703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:04.374209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:04.382078 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c687e245-be04-4e25-b3d2-3ba7c6436fbc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.162382 Jan 17 02:39:04.382674 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 437/838] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:04 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:04.519892 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:04.520734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:04.527293 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:04.527817 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:04.528594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:04.529028 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:04.668174 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:04.677387 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:04.679007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:04.680182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5c195be8-b7c4-48db-89de-60381fdbbc4c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.165102 Jan 17 02:39:04.680735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 402/839] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:04 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:04.861673 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-60211644-911b-4044-9a99-874470ca244a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dce1dc0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:04.894207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-60211644-911b-4044-9a99-874470ca244a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.038657 Jan 17 02:39:04.894770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 438/840] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:04 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:39:05.402841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:05.403871 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:05.414636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:05.415399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:05.416751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:05.417480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:05.549788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:05.557707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e4febd40-aa7f-40af-b4fd-db28ae5fa448 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.160974 Jan 17 02:39:05.558304 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 403/841] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:05 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:05.703766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:05.704790 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:05.714895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:05.715733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:05.716623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:05.717058 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:05.858953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:05.867002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:05.868561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:05.869707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-32d0e0c0-2664-4c92-8f8d-a8414b0d75eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.173008 Jan 17 02:39:05.870267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 439/842] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:05 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:05.906165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4975c606-db61-4683-ac65-6addf5e59269 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074ddd2160>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:05.933524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4975c606-db61-4683-ac65-6addf5e59269 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.031400 Jan 17 02:39:05.934055 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 404/843] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:05 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:39:06.575428 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:06.576053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:06.582400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:06.582857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:06.583637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:06.584085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:06.724660 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:06.733251 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f331d3f7-0937-41d5-a109-e4f7b60c1d9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.161427 Jan 17 02:39:06.733830 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 440/844] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:06 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:06.889064 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:06.889695 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:06.895954 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:06.896457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:06.897222 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:06.897650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:06.946587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2bc6e0b9-cd5f-4a8b-a97d-88f2023ed2d8 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dca7b80>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:06.980800 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2bc6e0b9-cd5f-4a8b-a97d-88f2023ed2d8 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 288 microversion: 2.1 time: 0.037795 Jan 17 02:39:06.981415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 441/845] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:06 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:06.991089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e3756f65-5f65-4f60-b326-501068490c81 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dcdba60>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:07.037239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:07.045851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:07.046272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e3756f65-5f65-4f60-b326-501068490c81 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 202 len: 0 microversion: 2.1 time: 0.058794 Jan 17 02:39:07.046891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 442/846] 10.222.0.24 () {58 vars in 1253 bytes} [Mon Jan 17 02:39:06 2022] DELETE /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:39:07.047429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:07.048942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-445e1635-0c8c-45ac-b3f0-bb9bc772f99e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.164490 Jan 17 02:39:07.049481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 405/847] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:06 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:07.054864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-01576825-85ce-4869-9d6c-a0ae775c389b tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dd5adc0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:07.082949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-01576825-85ce-4869-9d6c-a0ae775c389b tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 200 len: 287 microversion: 2.1 time: 0.031353 Jan 17 02:39:07.083464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 443/848] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:07 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:07.754240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:07.755230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:07.764656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:07.765112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:07.765894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:07.766330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:07.904627 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:07.913039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cbf47d67-2e8a-4a8f-b0f2-a3b4aa7663dc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.165040 Jan 17 02:39:07.913607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 406/849] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:07 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:08.067649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:08.068373 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:08.074623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:08.075119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:08.075957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:08.076600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:08.097391 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-24a49ab5-aecb-4182-ad5e-5c98bb814b3a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dde2040>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:08.125423 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-24a49ab5-aecb-4182-ad5e-5c98bb814b3a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] HTTP exception thrown: Snapshot 2ab619f8-05b8-444f-8ccc-ebc53c4bc102 could not be found. Jan 17 02:39:08.126028 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-24a49ab5-aecb-4182-ad5e-5c98bb814b3a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Returning 404 to user: Snapshot 2ab619f8-05b8-444f-8ccc-ebc53c4bc102 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:39:08.126838 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-24a49ab5-aecb-4182-ad5e-5c98bb814b3a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102" status: 404 len: 111 microversion: 2.1 time: 0.035681 Jan 17 02:39:08.127407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 407/850] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:39:08 2022] GET /compute/v2.1/os-snapshots/2ab619f8-05b8-444f-8ccc-ebc53c4bc102 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 02:39:08.135754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-76b96d38-b819-44ad-a6e3-a7967d2ed235 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074ddd2160>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:08.209311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-76b96d38-b819-44ad-a6e3-a7967d2ed235 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 202 len: 0 microversion: 2.1 time: 0.077497 Jan 17 02:39:08.210039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 408/851] 10.222.0.24 () {58 vars in 1247 bytes} [Mon Jan 17 02:39:08 2022] DELETE /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:39:08.218037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-52e204ea-e444-4191-8d08-e7bb357b0133 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074ddd2280>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:08.220089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:08.228281 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:08.229784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:08.230933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e17a997e-5d35-4d11-b6bf-edc6af124d5c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.167556 Jan 17 02:39:08.231580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 444/852] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:08 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:08.263083 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-52e204ea-e444-4191-8d08-e7bb357b0133 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 200 len: 345 microversion: 2.1 time: 0.048672 Jan 17 02:39:08.263646 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 409/853] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:08 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:39:08.934045 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:08.935072 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:08.941835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:08.942307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:08.943118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:08.943569 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:09.078530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:09.087108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fcf8c604-b3a9-4199-967a-539db35193cf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.159208 Jan 17 02:39:09.087678 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 445/854] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:08 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:09.249393 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:09.250000 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:09.256632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:09.257080 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:09.257859 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:09.258309 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:09.276088 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-19e3b035-8c85-4d6d-a2ee-f652545153a5 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dcd1430>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:09.322353 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-19e3b035-8c85-4d6d-a2ee-f652545153a5 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 200 len: 345 microversion: 2.1 time: 0.049942 Jan 17 02:39:09.323003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 446/855] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:09 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:09.400681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:09.409561 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:09.411055 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:09.412269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8212b60c-b75f-4d6d-ae0a-310ac220d59d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.167025 Jan 17 02:39:09.412827 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 410/856] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:09 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:10.108904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:10.109894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:10.120216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:10.120969 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:10.122309 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:10.122746 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:10.259439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:10.267770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e653f9cc-3aef-4a82-9b4e-2eecd056289e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.165743 Jan 17 02:39:10.268611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 447/857] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:10 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:10.338582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-86907755-5c3c-4d2b-8f01-77b8567aa6de tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f075308d790>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:10.385247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-86907755-5c3c-4d2b-8f01-77b8567aa6de tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 200 len: 345 microversion: 2.1 time: 0.052813 Jan 17 02:39:10.385804 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 411/858] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:10 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:10.433282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:10.434310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:10.440869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:10.441313 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:10.442087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:10.442521 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:10.582392 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:10.594041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:10.595570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:10.596749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a51bd517-fbd0-4103-871d-f36fd5a67417 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.169134 Jan 17 02:39:10.597312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 448/859] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:10 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:11.288513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:11.289366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:11.297126 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:11.297573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:11.298347 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:11.298779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:11.398118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a7bd55fd-a766-4da6-a342-c35b31569fdf tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dd5a9d0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:11.434234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:11.442330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2a44292f-3e1d-4650-a94d-a231fc5431d5 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.159724 Jan 17 02:39:11.443000 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 412/860] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:11 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:11.444969 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a7bd55fd-a766-4da6-a342-c35b31569fdf tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 200 len: 345 microversion: 2.1 time: 0.050404 Jan 17 02:39:11.445548 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 449/861] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:11 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:11.615397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:11.616007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:11.622555 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:11.623003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:11.623780 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:11.624248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:11.777674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:11.786225 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:11.787700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:11.788864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ca4d885f-e635-43e2-9aaa-fa9eed426c2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.177310 Jan 17 02:39:11.789397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 413/862] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:11 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:12.462390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-615b712b-685e-4942-9607-6c0d16528b3c tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dc24820>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:12.463244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:12.464411 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:12.471650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:12.472109 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:12.472915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:12.473352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:12.508815 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-615b712b-685e-4942-9607-6c0d16528b3c tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 200 len: 345 microversion: 2.1 time: 0.053677 Jan 17 02:39:12.509380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 450/863] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:12 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:12.607621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:12.615913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1f9bf310-8e4b-4e18-8def-993807de7630 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.158874 Jan 17 02:39:12.616497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 414/864] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:12 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:12.810809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:12.811702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:12.822957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:12.823706 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:12.825041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:12.825657 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:12.954862 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:12.962830 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:12.964325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:12.965457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cacd6c34-fbf2-4598-b2b1-6b44925d011f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.161176 Jan 17 02:39:12.966001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 451/865] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:12 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:13.520583 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7b58237b-3fd3-4690-9d05-843844ead2f4 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f0753071670>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:13.547721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-7b58237b-3fd3-4690-9d05-843844ead2f4 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] HTTP exception thrown: Volume 634f85b7-dee7-487b-9a71-51f0496effdb could not be found. Jan 17 02:39:13.548514 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7b58237b-3fd3-4690-9d05-843844ead2f4 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Returning 404 to user: Volume 634f85b7-dee7-487b-9a71-51f0496effdb could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:39:13.549584 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7b58237b-3fd3-4690-9d05-843844ead2f4 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 404 len: 109 microversion: 2.1 time: 0.032678 Jan 17 02:39:13.550126 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 415/866] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:13 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:39:13.565473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-913c5008-3541-40d3-a765-d2111e822116 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f074dca7ee0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:13.595255 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-913c5008-3541-40d3-a765-d2111e822116 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] HTTP exception thrown: Volume 634f85b7-dee7-487b-9a71-51f0496effdb could not be found. Jan 17 02:39:13.595856 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-913c5008-3541-40d3-a765-d2111e822116 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Returning 404 to user: Volume 634f85b7-dee7-487b-9a71-51f0496effdb could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:39:13.596718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-913c5008-3541-40d3-a765-d2111e822116 tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 404 len: 109 microversion: 2.1 time: 0.036793 Jan 17 02:39:13.597424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 452/867] 10.222.0.24 () {58 vars in 1247 bytes} [Mon Jan 17 02:39:13 2022] DELETE /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:39:13.605604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-08d15e1a-c94c-4645-b401-a28b30690b0a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Calling method '.version_select at 0x7f075308a670>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:13.632989 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:13.633603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:13.638827 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-08d15e1a-c94c-4645-b401-a28b30690b0a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] HTTP exception thrown: Volume 634f85b7-dee7-487b-9a71-51f0496effdb could not be found. Jan 17 02:39:13.639594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-08d15e1a-c94c-4645-b401-a28b30690b0a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] Returning 404 to user: Volume 634f85b7-dee7-487b-9a71-51f0496effdb could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:39:13.640694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-08d15e1a-c94c-4645-b401-a28b30690b0a tempest-VolumesSnapshotsTestJSON-2134913960 tempest-VolumesSnapshotsTestJSON-2134913960-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb" status: 404 len: 109 microversion: 2.1 time: 0.038834 Jan 17 02:39:13.640895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:13.641295 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:13.641428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 416/868] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:39:13 2022] GET /compute/v2.1/os-volumes/634f85b7-dee7-487b-9a71-51f0496effdb => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:39:13.642377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:13.642850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:13.823174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:13.831845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-180f9ba4-631f-4ea2-b9d7-8fea62354187 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.202472 Jan 17 02:39:13.832445 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 453/869] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:13 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:39:13.983853 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:13.984503 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:13.990406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:13.990863 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:13.991647 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:13.992129 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:14.126510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:14.134587 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:14.136291 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:14.137628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-67acdddb-0e6e-4d9d-b479-666ec98383d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.157614 Jan 17 02:39:14.138376 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 417/870] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:13 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:14.849796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:14.850178 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:14.856748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:14.857304 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:14.858227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:14.858739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:15.010703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:15.029511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4e426c6a-1827-4f8e-94f6-5936c2b83788 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.183401 Jan 17 02:39:15.030315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 454/871] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:14 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:15.157515 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:15.158134 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:15.165167 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:15.165615 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:15.167944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:15.168495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:15.314350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:15.322238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:15.323796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:15.325170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9c421f8c-4c0f-4158-9cb5-104505129269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.172045 Jan 17 02:39:15.325801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 418/872] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:15 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:16.048652 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:16.049418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:16.057568 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:16.058131 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:16.059102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:16.059644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:16.207131 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:16.215755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e7effb12-6a10-40dd-b3ba-0e5d0d114773 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.172033 Jan 17 02:39:16.216394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 455/873] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:16 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:16.343691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:16.344314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:16.350833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:16.351273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:16.352058 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:16.352521 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:16.482474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:16.491575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:16.493312 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:16.494737 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5cfd217b-5879-4a51-b121-6518af0787f8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.154824 Jan 17 02:39:16.495524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 419/874] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:16 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:17.233772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:17.234991 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:17.241188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:17.241636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:17.242425 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:17.242891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:17.379526 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:17.387330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7350ff2c-31df-4643-b98f-43211a890458 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.158293 Jan 17 02:39:17.393598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 456/875] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:17 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:17.523029 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:17.524437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:17.532747 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:17.533197 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:17.533981 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:17.534700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:17.668300 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:17.675438 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:17.676957 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:17.678105 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b58ee18c-35c1-4f32-910c-d41b61baad3c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.159140 Jan 17 02:39:17.678667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 420/876] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:17 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:18.404503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:18.405103 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:18.411977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:18.412488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:18.413303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:18.413701 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:18.547374 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:18.555470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c4da6ee8-a217-4415-a265-5cac6c8ebcd6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.154726 Jan 17 02:39:18.556033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 457/877] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:18 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:18.696743 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:18.697337 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:18.703853 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:18.704321 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:18.705116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:18.705577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:18.845038 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:18.852970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:18.854455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:18.855602 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-870d5dba-3eb5-4159-9544-c20dc35cf652 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.162994 Jan 17 02:39:18.856180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 421/878] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:18 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:19.572505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:19.573065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:19.579855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:19.580037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:19.581007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:19.581618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:19.715891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:19.724348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-878961f8-989e-4bfa-a54c-f1a06ae433bf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.155706 Jan 17 02:39:19.725400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 458/879] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:19 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:19.873492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:19.880793 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:19.887428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:19.887947 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:19.889426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:19.889873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:20.023149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:20.031839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:20.033368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:20.034543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-851a99bb-9d50-4cad-884c-a536c0b7a8d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.165194 Jan 17 02:39:20.035364 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 422/880] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:19 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:20.743528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:20.744167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:20.750811 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:20.751267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:20.752050 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:20.752513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:20.887126 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:20.895501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f05631f3-8d87-4c76-a916-ba08bb9cb07e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.156014 Jan 17 02:39:20.896094 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 459/881] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:20 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:21.052903 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:21.053465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:21.060059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:21.060540 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:21.061312 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:21.061741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:21.203084 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:21.209940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:21.211426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:21.212639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b31adfd9-46ae-4ab5-a0fe-020f36fb457b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.163540 Jan 17 02:39:21.213227 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 423/882] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:21 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:21.912931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:21.913553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:21.920426 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:21.920860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:21.921636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:21.922058 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:22.050864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:22.058953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e37757f9-28fe-49d8-be3a-18914304e3fe tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.149666 Jan 17 02:39:22.059500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 460/883] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:21 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:22.230616 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:22.231298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:22.237752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:22.238270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:22.244308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:22.244909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:22.407662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:22.417244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:22.418771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:22.420380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d580308d-bc75-4278-93b5-5a476713ba3f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.193313 Jan 17 02:39:22.421106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 424/884] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:22 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:23.077066 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:23.077677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:23.084300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:23.084837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:23.085609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:23.086057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:23.226028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:23.233852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9d09a523-e571-431f-87ae-a168772f97de tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1723 microversion: 2.1 time: 0.160915 Jan 17 02:39:23.234470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 461/885] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:23 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:23.438374 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:23.443564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:23.451037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:23.451530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:23.452367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:23.452800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:23.599974 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:23.608408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:23.609900 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:23.611054 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1bf59004-c00c-491e-9fc8-e3ac6c30e22f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.176283 Jan 17 02:39:23.611600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 425/886] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:23 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:24.250505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:24.251098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:24.257632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.258078 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.258845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.259272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.273335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-251f1d16-4be1-47af-bdba-1e43604d93de req-1fb6285b-b040-4eed-be05-2ca8ea7175ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e3840c-9200-4dfe-8879-42d7cd878ec1", "name": "network-vif-plugged", "status": "completed", "tag": "c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:24.275288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:39:24.275288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:39:24.287842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-251f1d16-4be1-47af-bdba-1e43604d93de req-1fb6285b-b040-4eed-be05-2ca8ea7175ae service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.288478 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-251f1d16-4be1-47af-bdba-1e43604d93de req-1fb6285b-b040-4eed-be05-2ca8ea7175ae service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.303533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-251f1d16-4be1-47af-bdba-1e43604d93de req-1fb6285b-b040-4eed-be05-2ca8ea7175ae service nova] Creating event network-vif-plugged:c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a for instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 on hv-cinder-82160 Jan 17 02:39:24.308863 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-251f1d16-4be1-47af-bdba-1e43604d93de req-1fb6285b-b040-4eed-be05-2ca8ea7175ae service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039234 Jan 17 02:39:24.309516 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 426/887] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:39:24.420563 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:24.428842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3f30b325-8772-4fcc-9501-60c514cfdd8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1700 microversion: 2.1 time: 0.181969 Jan 17 02:39:24.429378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 462/888] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:24 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:24.445928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e9c67e53-e5aa-4b85-a807-77fd331bdc33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:24.452196 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e9c67e53-e5aa-4b85-a807-77fd331bdc33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.452648 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e9c67e53-e5aa-4b85-a807-77fd331bdc33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.518250 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e9c67e53-e5aa-4b85-a807-77fd331bdc33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Going to try to start instance {{(pid=122782) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 17 02:39:24.565736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e9c67e53-e5aa-4b85-a807-77fd331bdc33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 202 len: 0 microversion: 2.1 time: 0.123966 Jan 17 02:39:24.566611 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 427/889] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:39:24 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:39:24.574665 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:24.575479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:24.582710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.583302 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.583931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.584413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.629844 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:24.630535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:24.637061 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.637764 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.638741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:24.639219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:24.786424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:24.796087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-706a0ea2-70a1-4296-8553-47e6740e87d7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.225207 Jan 17 02:39:24.796766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 463/890] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:24 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:24.834275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:24.842247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:24.843830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:24.844988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8009cf1b-fc5f-40c0-bc70-fc3d43dc16db tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1744 microversion: 2.20 time: 0.219273 Jan 17 02:39:24.845759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 428/891] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:24 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:25.818070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:25.818977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:25.829567 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:25.830361 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:25.831598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:25.832378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:25.862584 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:25.863189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:25.869833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:25.870283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:25.871098 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:25.871536 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:25.991608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:25.999687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-42d7f44a-42c5-4e34-a4f0-a84b19934a74 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.187807 Jan 17 02:39:26.000384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 464/892] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:25 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:26.055190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:26.062962 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:26.064462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:26.065600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-107e1690-54e6-450d-8db4-b54782f0bab3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.206715 Jan 17 02:39:26.066121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 429/893] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:25 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:27.021828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:27.023081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:27.033955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:27.034729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:27.036010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:27.036761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:27.084121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:27.084700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:27.091494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:27.091943 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:27.092754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:27.093187 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:27.250953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:27.259334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2b97e52a-92bf-4435-a106-c53e631afc1a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.243732 Jan 17 02:39:27.259892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 465/894] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:27 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:27.281373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:27.289696 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:27.291194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:27.292383 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3b7d6ae3-ad18-4e85-a792-6af045a9f75b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.211962 Jan 17 02:39:27.292924 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 430/895] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:27 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:28.276746 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:28.277377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:28.284576 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:28.285023 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:28.285794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:28.286224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:28.310619 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:28.311370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:28.318054 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:28.318505 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:28.319280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:28.319708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:28.476194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:28.484575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:28.486121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:28.487265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-60c55ae5-a25b-4c51-abf4-9a54a137bc09 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.180395 Jan 17 02:39:28.487816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 431/896] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:28 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:28.691215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:28.700917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7089831a-2738-4cb7-b32a-44d862b7656f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.427773 Jan 17 02:39:28.702929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 466/897] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:28 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:29.506625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:29.507159 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:29.513665 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:29.514160 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:29.515182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:29.515625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:29.666120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:29.675618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:29.677323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:29.681166 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c0ef96d0-67a7-4d4e-b992-6f0d232cdd30 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.178817 Jan 17 02:39:29.682210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 432/898] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:29 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:29.722842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:29.723554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:29.731532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:29.732078 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:29.732977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:29.733470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:29.947509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:29.959997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f7ff139a-ec2c-4199-a660-489f87ad9d58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.240786 Jan 17 02:39:29.961142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 467/899] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:29 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:30.702222 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:30.703532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:30.710287 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:30.710732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:30.711891 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:30.712950 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:30.874203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:30.882665 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:30.884864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:30.885747 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3f26b2c1-de47-4625-899d-d9c466b79d1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.190390 Jan 17 02:39:30.897693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 433/900] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:30 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:39:30.976704 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:30.977261 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:30.990507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:30.990976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:30.991791 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:30.992550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:31.145023 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:31.153527 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d0c663ed-07bf-43fa-8d6f-9b04a54a38ec tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.180616 Jan 17 02:39:31.157384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 468/901] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:30 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:31.904322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:31.906566 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:31.913971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:31.914445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:31.915247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:31.915679 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:32.154292 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:32.164245 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:32.166045 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:32.167435 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b88e098e-5625-4d60-97ab-13d937f5de81 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.267049 Jan 17 02:39:32.168058 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 434/902] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:31 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:32.174138 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:32.175383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:32.182073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:32.182525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:32.183521 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:32.183953 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:32.363133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:32.372082 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8f3dd1e4-29d0-4697-ba86-03952610a701 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.201635 Jan 17 02:39:32.372939 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 469/903] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:32 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:33.185075 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:33.186375 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:33.193077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:33.193712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:33.194664 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:33.195104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:33.347733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:33.357787 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:33.359244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:33.360481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5fe52312-4185-4b9a-bf27-8d6e88dc3881 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.179121 Jan 17 02:39:33.361030 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 435/904] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:33 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:33.389362 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:33.389971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:33.397017 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:33.397473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:33.398319 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:33.398761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:33.549728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:33.558194 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c8e8c51f-d509-4a37-bcfb-9194c588d091 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.172793 Jan 17 02:39:33.567751 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 470/905] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:33 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:34.378659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:34.379820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:34.387049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:34.387497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:34.388318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:34.388959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:34.538481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:34.547443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:34.548942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:34.550100 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-230e948f-de82-4020-b913-6abaab2bd85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.175180 Jan 17 02:39:34.550662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 436/906] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:34 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:34.574705 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:34.575319 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:34.582334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:34.582910 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:34.583886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:34.584761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:34.744506 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:34.753345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-82908b9a-8472-4b38-b51f-4966bfeb67ba tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1709 microversion: 2.1 time: 0.182317 Jan 17 02:39:34.754503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 471/907] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:34 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1709 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:35.573195 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:35.575283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:35.586162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:35.586910 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:35.588300 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:35.589503 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:35.730443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:35.746298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:35.747765 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:35.748952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-89adea73-ef50-40be-ac5d-8067a7c36a69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.182397 Jan 17 02:39:35.749501 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 437/908] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:35 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:35.902398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:35.903012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:35.911884 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:35.912429 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:35.913491 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:35.914311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:36.079519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:36.090631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6624592f-f7b4-4a39-8dfa-a08c45a67967 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1713 microversion: 2.1 time: 0.319705 Jan 17 02:39:36.092387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 472/909] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:35 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1713 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:36.768791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:36.769911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:36.778801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:36.779529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:36.780883 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:36.781314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:37.073571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:37.083238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:37.085351 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:37.086810 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a077deed-27e4-40d9-b784-e7e8ea28e872 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.323921 Jan 17 02:39:37.087619 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 438/910] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:36 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:38.105645 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:38.106342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:38.112939 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:38.113390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:38.114175 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:38.114618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:38.243656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:38.251594 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:38.253107 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:38.254249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cfc3fe33-2a22-43a9-8273-cfeecbe5f388 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.152320 Jan 17 02:39:38.254813 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 473/911] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:38 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:39.276710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:39.277355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:39.284818 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:39.285266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:39.286039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:39.286481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:39.423282 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:39.431454 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:39.432963 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:39.434102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cd8a8535-5fe4-4ec6-b4e7-3842c9fe532f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.162308 Jan 17 02:39:39.434625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 439/912] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:39 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:40.452497 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:40.453066 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:40.459802 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:40.460274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:40.461055 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:40.461483 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:40.596376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:40.604605 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:40.606070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:40.607206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0d951c0a-807c-4563-8cfb-e24225f77055 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.158394 Jan 17 02:39:40.607759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 474/913] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:40 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:41.625788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:41.626392 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:41.633462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:41.633915 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:41.634702 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:41.635141 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:41.777969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:41.786410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:41.787883 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:41.789056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0f2380f2-0539-41f5-99af-6efd34a012f5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.167120 Jan 17 02:39:41.789659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 440/914] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:41 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:42.806666 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:42.807267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:42.813727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:42.814172 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:42.814935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:42.815372 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:42.952791 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:42.961602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:42.963097 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:42.964293 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9980c414-00e1-410a-b287-8388c16acffc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1739 microversion: 2.20 time: 0.161392 Jan 17 02:39:42.964859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 475/915] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:42 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:43.533559 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:43.534107 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:43.540474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:43.540970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:43.541744 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:43.542204 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:43.619468 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lazy-loading 'services' on Instance uuid 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:39:43.693144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4c0a53a9-8066-4e51-8440-8ff76fd13996 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "DELETE /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7/os-volume_attachments/67717b91-6e4f-4592-a0f9-1e58577a6945" status: 202 len: 0 microversion: 2.1 time: 0.163613 Jan 17 02:39:43.693739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 441/916] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:39:43 2022] DELETE /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7/os-volume_attachments/67717b91-6e4f-4592-a0f9-1e58577a6945 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:39:44.097236 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:44.098214 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:44.104154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:44.104674 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:44.105520 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:44.106029 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:44.243121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:44.251514 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:44.253033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:44.254384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6bb44d46-0aa6-4e1b-a381-81fd025d770e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1721 microversion: 2.20 time: 0.275837 Jan 17 02:39:44.255343 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 476/917] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:43 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:45.275056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:45.275812 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:45.283653 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:45.284103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:45.284920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:45.285352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:45.426993 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:45.434892 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:45.436412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:45.437569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1279f81a-2a07-48c2-b1b0-53066c57135b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1721 microversion: 2.20 time: 0.167698 Jan 17 02:39:45.438132 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 442/918] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:45 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:46.456001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:46.456657 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:46.463421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:46.463876 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:46.464703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:46.465145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:46.871116 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:46.879245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:46.880765 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:46.881898 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-992cf410-b4e5-4f7d-a77c-2fe9df27afe6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1721 microversion: 2.20 time: 0.429739 Jan 17 02:39:46.882610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 477/919] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:46 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1721 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:47.465973 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-ada27f43-72fd-40a7-a3c1-284d3ded16c4 req-0d4bfefd-429e-4587-a7f5-4196aa846338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e3840c-9200-4dfe-8879-42d7cd878ec1", "name": "network-vif-unplugged", "status": "completed", "tag": "c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:47.467666 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:39:47.467666 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:39:47.475603 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-ada27f43-72fd-40a7-a3c1-284d3ded16c4 req-0d4bfefd-429e-4587-a7f5-4196aa846338 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:47.476210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-ada27f43-72fd-40a7-a3c1-284d3ded16c4 req-0d4bfefd-429e-4587-a7f5-4196aa846338 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:47.487641 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-ada27f43-72fd-40a7-a3c1-284d3ded16c4 req-0d4bfefd-429e-4587-a7f5-4196aa846338 service nova] Creating event network-vif-unplugged:c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a for instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 on hv-cinder-82160 Jan 17 02:39:47.492466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-ada27f43-72fd-40a7-a3c1-284d3ded16c4 req-0d4bfefd-429e-4587-a7f5-4196aa846338 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030233 Jan 17 02:39:47.493177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 443/920] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:39:47.903345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:47.904311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:47.914558 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:47.915246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:47.916488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:47.917201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:48.052091 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:48.060452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:48.061931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:48.063079 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1da739da-3d92-4b22-836a-39bb0b2e2ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1721 microversion: 2.20 time: 0.165494 Jan 17 02:39:48.063643 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 478/921] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:47 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:49.082723 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:49.083409 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:49.090034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:49.090483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:49.091266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:49.091703 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:49.232256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:49.246502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:49.248022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:49.249897 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b3611b8a-8f82-4fb7-9e7d-620b6d471734 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1721 microversion: 2.20 time: 0.171505 Jan 17 02:39:49.250727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 444/922] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:49 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:50.272541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:50.273374 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:50.280603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:50.281057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:50.281877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:50.282310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:50.425285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:50.433623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:50.435096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:50.436270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1ee506b6-21aa-4be1-8413-2020db595575 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1724 microversion: 2.20 time: 0.169053 Jan 17 02:39:50.436822 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 479/923] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:50 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:50.454359 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4062fc54-499f-4374-a870-95aca301a25a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ad75462-0847-4462-8e23-00c68dfdf958"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:50.455421 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4062fc54-499f-4374-a870-95aca301a25a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:50.461758 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4062fc54-499f-4374-a870-95aca301a25a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:50.462207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4062fc54-499f-4374-a870-95aca301a25a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:50.462980 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4062fc54-499f-4374-a870-95aca301a25a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:50.463411 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4062fc54-499f-4374-a870-95aca301a25a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:50.769902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4062fc54-499f-4374-a870-95aca301a25a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319702 Jan 17 02:39:50.770591 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 445/924] 10.222.0.24 () {62 vars in 1363 bytes} [Mon Jan 17 02:39:50 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:39:50.876629 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c20cdcc4-dac4-42b3-8dba-90ec7dfe0415 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:50.877292 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c20cdcc4-dac4-42b3-8dba-90ec7dfe0415 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:50.883268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c20cdcc4-dac4-42b3-8dba-90ec7dfe0415 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:50.883710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c20cdcc4-dac4-42b3-8dba-90ec7dfe0415 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:50.884505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c20cdcc4-dac4-42b3-8dba-90ec7dfe0415 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:50.884929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c20cdcc4-dac4-42b3-8dba-90ec7dfe0415 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:51.031801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c20cdcc4-dac4-42b3-8dba-90ec7dfe0415 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action" status: 202 len: 0 microversion: 2.20 time: 0.159105 Jan 17 02:39:51.032760 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 480/925] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:39:50 2022] POST /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:39:51.047926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:51.047926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:51.048850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:51.049175 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:51.049974 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:51.050403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:51.164618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:51.165114 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:51.171929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:51.172439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:51.173367 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:51.173809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:51.195999 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:51.200206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:39:51.204916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:51.206500 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:51.207651 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8dd6a30e-088d-4c91-a8cb-372886d61ebd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1750 microversion: 2.20 time: 0.170567 Jan 17 02:39:51.219075 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 446/926] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:51 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:51.286976 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6cd22129-c06b-4edd-bbca-e64cd4aed798 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "DELETE /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 204 len: 0 microversion: 2.1 time: 0.126970 Jan 17 02:39:51.287569 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 481/927] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:39:51 2022] DELETE /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 17 02:39:51.295759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:51.296396 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:51.302496 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:51.302951 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:51.303737 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:51.304236 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:51.443774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:51.451573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ab2049a2-b313-459a-a13b-cb419a956b24 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1514 microversion: 2.1 time: 0.159515 Jan 17 02:39:51.452352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 447/928] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:51 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:52.230167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:52.230167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:52.236245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:52.236700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:52.237480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:52.237909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:52.371596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:52.379888 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:52.381394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:52.382536 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9a250712-b021-478c-ac5a-cdae2b029ec4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1752 microversion: 2.20 time: 0.160350 Jan 17 02:39:52.383091 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 482/929] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:52 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:52.472816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:52.473860 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:52.484721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:52.485462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:52.486727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:52.487433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:52.786565 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:52.793987 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-383d9234-8ed8-4263-bdab-29cf8720fa7c tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1514 microversion: 2.1 time: 0.327411 Jan 17 02:39:52.794552 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 448/930] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:52 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1514 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:53.404508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:53.405699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:53.414566 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:53.415027 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:53.415805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:53.416289 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:53.548477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:53.556909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:53.558400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:53.559539 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-bc894705-604e-4ca8-86dd-b9ab4db7fe67 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1752 microversion: 2.20 time: 0.161608 Jan 17 02:39:53.560093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 483/931] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:53 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:53.814580 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:53.815574 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:53.825780 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:53.826549 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:53.828056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:53.828587 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:53.963947 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:53.971381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0c0bbf76-3ba0-4d0a-a66b-6d1e445bc794 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1514 microversion: 2.1 time: 0.162960 Jan 17 02:39:53.971986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 449/932] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:53 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:54.579133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:54.579760 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:54.587156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:54.587603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:54.588396 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:54.588828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:54.739759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:54.748689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:54.750184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:54.751335 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a9b7d489-c858-493c-b7d3-40b27258c0e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1752 microversion: 2.20 time: 0.176890 Jan 17 02:39:54.751899 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 484/933] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:54 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:54.992269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:54.993210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:55.003960 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:55.004773 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:55.006203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:55.006661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:55.141521 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:55.156624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fe60e841-456c-44c7-a9e8-815e79483563 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1514 microversion: 2.1 time: 0.170165 Jan 17 02:39:55.157483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 450/934] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:54 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:55.773743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:55.776169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:55.785580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:55.786554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:55.787606 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:55.788021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:55.925495 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:55.937187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:55.939533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:55.941310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9b200af9-e2bb-4e1e-8176-73b4d3adc9e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1752 microversion: 2.20 time: 0.173506 Jan 17 02:39:55.942096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 485/935] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:55 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:56.183186 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:56.184186 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:56.194738 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:56.195490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:56.196839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:56.197564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:56.334319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:56.341809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-04f0487b-002b-40e9-859b-7a7090f34815 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1514 microversion: 2.1 time: 0.164875 Jan 17 02:39:56.342368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 451/936] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:56 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:56.963377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:56.964528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:56.975176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:56.975935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:56.977282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:56.978008 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:57.121471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:57.133183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:57.134659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:57.135796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f31427a2-8731-4a4c-a033-3162d2880107 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1752 microversion: 2.20 time: 0.178726 Jan 17 02:39:57.136349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 486/937] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:56 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:57.367720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:57.369868 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:57.381264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:57.381712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:57.382511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:57.382951 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:57.527352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:57.538340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2de5d195-9461-4cf0-8e79-09cf27d8e011 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1514 microversion: 2.1 time: 0.177342 Jan 17 02:39:57.539149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 452/938] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:57 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:58.154351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:58.155312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:58.161735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:58.162272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:58.163044 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:58.163475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:58.307506 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:58.320117 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:58.322338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:58.324041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8bc580ea-aaef-4643-b67d-c03db2a5f695 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1752 microversion: 2.20 time: 0.173222 Jan 17 02:39:58.324891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 487/939] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:58 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:58.555068 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:58.556357 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:58.562444 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:58.562883 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:58.563687 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:58.564135 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:58.798205 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859d11fc332245eabb21143a3fd4d143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b592dcedb947f490f7fe030daba362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:58.805624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8d02e2f7-8dad-4126-8a58-eb9fe26aae75 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 200 len: 1514 microversion: 2.1 time: 0.254261 Jan 17 02:39:58.806195 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 453/940] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:58 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:39:59.027641 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-52ffcc67-6237-48a6-a249-a5fb46765ee5 req-8f4f33b7-a9b7-4c4c-8793-9d6fbba92886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0fc10a-49d6-4039-9d8b-2dc4183b54b7", "name": "network-vif-deleted", "tag": "8621d1fb-d919-4954-b511-5c85c9126b23"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:39:59.029249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:39:59.029249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:39:59.036522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-52ffcc67-6237-48a6-a249-a5fb46765ee5 req-8f4f33b7-a9b7-4c4c-8793-9d6fbba92886 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:59.037197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-52ffcc67-6237-48a6-a249-a5fb46765ee5 req-8f4f33b7-a9b7-4c4c-8793-9d6fbba92886 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:59.048421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-52ffcc67-6237-48a6-a249-a5fb46765ee5 req-8f4f33b7-a9b7-4c4c-8793-9d6fbba92886 service nova] Creating event network-vif-deleted:8621d1fb-d919-4954-b511-5c85c9126b23 for instance 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 on hv-cinder-82160 Jan 17 02:39:59.053323 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-52ffcc67-6237-48a6-a249-a5fb46765ee5 req-8f4f33b7-a9b7-4c4c-8793-9d6fbba92886 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087956 Jan 17 02:39:59.054464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 488/941] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:39:59.347445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:59.348222 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:59.354583 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:59.355038 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:59.355817 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:59.356290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:59.503004 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:59.511944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:59.513462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:39:59.514620 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9ea0599a-3012-4fa4-b603-cdd3a5142065 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.172308 Jan 17 02:39:59.515168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 454/942] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:39:59 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:39:59.823536 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:39:59.824291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] [instance: 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:39:59.830864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:59.831343 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:59.832102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:39:59.832570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:39:59.846075 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] HTTP exception thrown: Instance 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 could not be found. Jan 17 02:39:59.846658 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] Returning 404 to user: Instance 4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:39:59.847501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-23eebfd9-1058-4447-83a9-5daa627d8ee4 tempest-VolumesSnapshotTestJSON-777164675 tempest-VolumesSnapshotTestJSON-777164675-project] 10.222.0.24 "GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7" status: 404 len: 111 microversion: 2.1 time: 0.028451 Jan 17 02:39:59.848018 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 489/943] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:39:59 2022] GET /compute/v2.1/servers/4e0fc10a-49d6-4039-9d8b-2dc4183b54b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:40:00.543538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:00.544524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:00.554551 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:00.555003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:00.555780 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:00.556248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:00.696183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:00.704895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:00.706383 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:00.707535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7a0f956e-cf2c-4224-861f-c4f6e58e51b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.171149 Jan 17 02:40:00.708082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 455/944] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:00 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:01.729245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:01.729887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:01.738749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:01.739345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:01.740440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:01.741018 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:01.891282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:01.900228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:01.901716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:01.902888 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ca5b5bc1-8bed-46d7-ac14-cbd036d90b0d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.179243 Jan 17 02:40:01.903648 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 490/945] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:01 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:02.925756 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:02.926795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:02.934200 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:02.934743 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:02.935530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:02.935965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:03.064510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:03.072795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:03.074282 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:03.075434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-499e2053-fd97-49d2-90a2-76c8c2574b50 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.155983 Jan 17 02:40:03.075986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 456/946] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:02 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:04.098076 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:04.098768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:04.105644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:04.106098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:04.106941 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:04.107354 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:04.311864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:04.320599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:04.322096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:04.323249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-74c745bf-457d-4eed-b908-486e2e908074 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.230449 Jan 17 02:40:04.324025 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 491/947] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:04 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:05.344677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:05.345240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:05.352907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:05.353364 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:05.354155 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:05.355037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:05.526576 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:05.538103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:05.539639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:05.540838 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-12e339aa-01af-4a55-906c-ea03b4093d2c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.202008 Jan 17 02:40:05.541395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 457/948] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:05 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:06.560452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:06.561059 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:06.567688 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:06.568184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:06.568984 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:06.569478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:06.731000 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:06.742396 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:06.745887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:06.747314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-41711804-d3f6-49ad-9f44-49c6192d9776 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.190680 Jan 17 02:40:06.748240 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 492/949] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:06 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:07.766562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:07.767251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:07.773756 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:07.774280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:07.775133 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:07.775625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:07.911902 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:07.921348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:07.922835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:07.924056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b77addf7-7639-4d2d-8ad4-4927095e7972 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.161105 Jan 17 02:40:07.924540 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 458/950] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:07 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:08.946939 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:08.947889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:08.958528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:08.959283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:08.960628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:08.961572 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:09.104586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:09.113712 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:09.115202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:09.116444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-58cbff6d-3ee8-4204-8eef-07dad530fcf8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.175936 Jan 17 02:40:09.117146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 493/951] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:08 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:10.137424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:10.138112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:10.144711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:10.145194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:10.145990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:10.146564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:10.290147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:10.298517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:10.300012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:10.301207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d32b8aa2-83de-4ec3-a688-7087305be5cc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.168035 Jan 17 02:40:10.301760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 459/952] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:10 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:11.319113 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:11.319728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:11.330464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:11.333527 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:11.337955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:11.338511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:11.472534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:11.480996 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:11.482472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:11.483613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2baf9f42-e9cb-425f-a2a7-ec7c87f58c88 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.168322 Jan 17 02:40:11.484202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 494/953] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:11 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:12.506079 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:12.507013 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:12.517622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:12.518396 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:12.519684 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:12.520480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:12.673642 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:12.684404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:12.685909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:12.687077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bfaef576-15b2-44e8-a633-bcb878b33a16 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.187605 Jan 17 02:40:12.687623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 460/954] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:12 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:13.708359 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:13.709336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:13.719965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:13.720774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:13.722057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:13.722794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:13.865669 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:13.876435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:13.878019 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:13.879212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-99566bb1-e54f-4bd8-b756-10515c18159e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.177186 Jan 17 02:40:13.894889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 495/955] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:13 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:14.897199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:14.903000 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:14.910384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:14.910805 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:14.911828 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:14.912310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:15.063443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:15.071634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:15.073203 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:15.074359 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5a0efab2-76fa-4f31-a818-2c3c2fce2045 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.180977 Jan 17 02:40:15.075119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 461/956] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:14 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:16.094174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:16.094843 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:16.101946 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:16.102322 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:16.103108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:16.103584 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:16.249064 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:16.257935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:16.259354 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:16.260586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-49c28ba2-e7c8-4c28-bc53-edca4c69109b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.171010 Jan 17 02:40:16.261137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 496/957] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:16 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:17.278582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:17.280266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:17.287924 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:17.288655 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:17.289739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:17.290386 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:17.493593 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:17.514288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:17.516474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:17.518523 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e685f746-da07-4a2a-be32-d2c3d4bc6b94 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.243629 Jan 17 02:40:17.520001 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 462/958] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:17 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:40:18.409672 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:40:18.410293 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 02:40:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:40:18.538307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:18.539176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:18.547341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:18.548047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:18.549410 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:18.550059 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:18.764606 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:18.775338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:18.777648 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:18.779717 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1b831a46-f3dd-497b-a3b5-d08ce1725d54 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.244725 Jan 17 02:40:18.780901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 497/959] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:18 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:40:19.797542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:19.798436 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:19.805933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:19.806447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:19.807394 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:19.807827 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:19.955743 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:19.963174 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:19.965098 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:19.966264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b367babe-432d-4d72-9d19-1c349d54dedc tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.172521 Jan 17 02:40:19.966814 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 463/960] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:19 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:20.985389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:20.986134 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:20.992429 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:20.992870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:20.993660 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:20.994285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:21.153536 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:21.162820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:21.164337 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:21.165495 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9528bfcb-d73d-4c5b-b650-eea1e268c6eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.184291 Jan 17 02:40:21.166048 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 498/961] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:20 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:22.183340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:22.184001 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:22.191445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:22.191999 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:22.192775 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:22.193194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:22.333601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:22.342100 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:22.343646 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:22.344986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8a434bc4-e781-4577-bb23-1ffa9ed28de5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.165657 Jan 17 02:40:22.345618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 464/962] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:22 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:23.372311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:23.373161 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:23.384089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:23.384574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:23.385378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:23.385814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:23.532634 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:23.541684 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:23.543239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:23.544423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9e9a4301-5e88-4ccc-b297-ef9ab6fa7d48 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.180168 Jan 17 02:40:23.544974 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 499/963] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:23 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:24.562693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:24.563297 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:24.569765 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:24.570207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:24.571015 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:24.571440 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:24.702022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:24.714827 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:24.717158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:24.718881 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-93dbbdbc-54d0-4745-a700-6de0c3e36c45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.159677 Jan 17 02:40:24.719650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 465/964] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:24 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:25.745371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:25.746290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:25.756675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:25.757437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:25.758727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:25.759453 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:25.897046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:25.905880 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:25.907397 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:25.908623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c77c2694-8596-439f-a9cb-ee280e6feaba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.169639 Jan 17 02:40:25.909162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 500/965] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:25 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:26.930798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:26.931585 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:26.939183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:26.939630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:26.940462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:26.940897 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:27.071114 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:27.080235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:27.081712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:27.082886 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-31a2e2bc-010f-4a90-bcb9-f040964fb310 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.158192 Jan 17 02:40:27.083426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 466/966] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:26 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:28.101056 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:28.102455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:28.107924 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:28.108463 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:28.109898 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:28.110336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:28.254087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:28.262166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:28.263782 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:28.264952 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a68ec2f9-f040-42df-8845-af58e6279e64 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.167760 Jan 17 02:40:28.276174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 501/967] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:28 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:29.284674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:29.285278 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:29.291966 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:29.292491 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:29.293301 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:29.293759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:29.438923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:29.447880 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:29.449508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:29.450684 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9db6b106-9067-4fb3-adbe-a593bf7319bb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.169751 Jan 17 02:40:29.451240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 467/968] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:29 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:30.472877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:30.473912 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:30.484573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:30.485322 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:30.486602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:30.487325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:30.629198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:30.637631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:30.639121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:30.640443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0908d87e-cf10-43a0-98db-55b93a696471 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.173912 Jan 17 02:40:30.640948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 502/969] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:30 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:31.662566 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:31.663335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:31.671819 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:31.672613 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:31.673298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:31.673734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:31.808249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:31.816854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:31.818353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:31.819513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8afbc07a-6304-49d3-ae76-a6bea1944636 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.163701 Jan 17 02:40:31.820086 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 468/970] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:31 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:32.841579 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:32.842560 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:32.850149 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:32.850610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:32.851368 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:32.851800 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:32.989017 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:33.001557 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:33.003772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:33.005598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b1b7e9e7-b7ba-4e5c-a0a9-61bb26628e1e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.169839 Jan 17 02:40:33.006355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 503/971] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:32 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:34.029086 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:34.030242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:34.037951 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:34.038403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:34.039187 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:34.039630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:34.174798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:34.183754 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:34.185309 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:34.186468 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ecf5ea5f-d41c-4b7f-a4ec-780c16389c9f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.164356 Jan 17 02:40:34.187020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 469/972] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:34 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:35.205186 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:35.205937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:35.212609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:35.213051 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:35.213818 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:35.214249 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:35.350013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:35.358501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:35.359986 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:35.361159 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3b6bcf37-b64f-49cd-bf8f-2904083b2049 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.160379 Jan 17 02:40:35.361762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 504/973] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:35 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:36.379497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:36.380195 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:36.386473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:36.387604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:36.388492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:36.388992 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:36.520105 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:36.528368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:36.530359 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:36.531614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-33bd50f8-297d-4861-b568-cc4c8bf13b8b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.156185 Jan 17 02:40:36.532492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 470/974] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:36 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:37.551065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:37.551661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:37.558306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:37.558752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:37.559520 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:37.559955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:37.976971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:37.987113 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:37.997980 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:37.999168 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8d857653-ff89-48af-8799-a339cf6f22df tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.452229 Jan 17 02:40:37.999702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 505/975] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:37 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:38.469216 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-fddd622c-a9f3-4ff6-a03d-f7fdd367e0f0 req-eaa373af-1534-4346-a6b1-549d6a13f2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e3840c-9200-4dfe-8879-42d7cd878ec1", "name": "network-vif-plugged", "status": "completed", "tag": "c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:40:38.470987 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:40:38.470987 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:40:38.478009 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-fddd622c-a9f3-4ff6-a03d-f7fdd367e0f0 req-eaa373af-1534-4346-a6b1-549d6a13f2d1 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:38.478450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-fddd622c-a9f3-4ff6-a03d-f7fdd367e0f0 req-eaa373af-1534-4346-a6b1-549d6a13f2d1 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:38.489663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-fddd622c-a9f3-4ff6-a03d-f7fdd367e0f0 req-eaa373af-1534-4346-a6b1-549d6a13f2d1 service nova] Creating event network-vif-plugged:c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a for instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 on hv-cinder-82160 Jan 17 02:40:38.495238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-fddd622c-a9f3-4ff6-a03d-f7fdd367e0f0 req-eaa373af-1534-4346-a6b1-549d6a13f2d1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214520 Jan 17 02:40:38.496189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 471/976] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:40:39.017299 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:39.017938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:39.027757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:39.028209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:39.029355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:39.030390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:39.245797 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:39.260665 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:39.262478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:39.271501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fce773e4-b1cf-49f6-9019-266c05cd2bab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.257761 Jan 17 02:40:39.283173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 506/977] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:39 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:40.291490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:40.292969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:40.301269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:40.301736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:40.302529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:40.302962 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:40.450418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:40.459408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:40.460940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:40.462197 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d1975c8c-3568-476a-82c0-7bfc09d79688 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.175444 Jan 17 02:40:40.462849 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 472/978] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:40 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:41.483469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:41.484151 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:41.491977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:41.492747 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:41.494461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:41.495794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:41.742291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:41.750700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:41.752747 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:41.754387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b74a5b76-77b1-4491-ad27-07b5e8e2d36d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1808 microversion: 2.20 time: 0.275719 Jan 17 02:40:41.755136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 507/979] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:41 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:40:42.773625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:40:42.774226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:40:42.782350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:42.782999 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:42.783970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:40:42.784424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:40:42.934232 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:42.943508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:42.956484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:40:42.957772 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2727aec0-b9fd-4ce1-8170-72e5a4ce4dbd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1795 microversion: 2.20 time: 0.188289 Jan 17 02:40:42.958433 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 473/980] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:40:42 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1795 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:41:10.430239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:10.431227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:10.438887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:10.439770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:10.440803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:10.441272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:10.554808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lazy-loading 'services' on Instance uuid c3d7c373-a92e-48a3-8605-f8655cf5cba4 {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:41:10.677730 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-84d33b3d-41b5-44b5-8106-88adf38d5ec7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-volume_attachments/9c7a9b37-113f-4e1d-bb9f-078720704735" status: 202 len: 0 microversion: 2.1 time: 0.251186 Jan 17 02:41:10.689383 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 508/981] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:41:10 2022] DELETE /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-volume_attachments/9c7a9b37-113f-4e1d-bb9f-078720704735 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:41:11.810151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-23087504-4a90-4833-b092-003794c38865 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:11.820918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-23087504-4a90-4833-b092-003794c38865 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:11.821370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-23087504-4a90-4833-b092-003794c38865 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:11.844639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-23087504-4a90-4833-b092-003794c38865 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Going to try to stop instance {{(pid=122782) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 17 02:41:11.903711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-23087504-4a90-4833-b092-003794c38865 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 202 len: 0 microversion: 2.1 time: 0.105342 Jan 17 02:41:11.908240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 474/982] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:41:11 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:41:11.913959 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:11.915313 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:11.921649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:11.922320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:11.923107 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:11.923541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:12.074346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:12.082290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b3f8ebcc-1ce0-49d2-b9a4-2b0622da2d35 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.173215 Jan 17 02:41:12.082948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 509/983] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:11 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:41:13.099867 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:13.100960 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:13.108026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:13.108592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:13.109466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:13.109964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:13.261773 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:13.269657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-11309be2-247c-4509-bed8-e9d8c5ef7913 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.174611 Jan 17 02:41:13.276524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 475/984] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:13 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:14.290174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:14.291729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:14.298501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:14.299232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:14.300093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:14.300711 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:14.464388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:14.477819 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Action: 'create', calling method: .version_select at 0x7f074dd16940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1708365876"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:14.482845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2f489a0d-f78c-4ccc-ab22-5802cf408037 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.196090 Jan 17 02:41:14.492505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 510/985] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:14 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:14.492694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Getting quotas for project 64e093625bec4998bc4012524037d1eb. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:41:14.496493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Getting quotas for user 84b0b72a72a148d6bd409a7a4afd81c7 and project 64e093625bec4998bc4012524037d1eb. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:41:14.507831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: ERROR oslo.messaging._drivers.impl_rabbit [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [5cd778eb-1d88-46d4-983d-5fa9ca2a378e] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:41:15.499937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:15.500611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:15.507166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:15.507693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:15.508593 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:15.509093 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:15.517039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [5cd778eb-1d88-46d4-983d-5fa9ca2a378e] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 49472. Jan 17 02:41:15.659874 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:15.668022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-51f86192-f287-47fd-ad8c-cee796ec7671 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.171968 Jan 17 02:41:15.668702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 511/986] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:15 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:15.689932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Getting quotas for project 64e093625bec4998bc4012524037d1eb. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:41:15.693632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Getting quotas for user 84b0b72a72a148d6bd409a7a4afd81c7 and project 64e093625bec4998bc4012524037d1eb. Resources: {'key_pairs'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:41:15.706221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-16ddbb01-a526-458c-8d37-f60823e39d5a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.232217 Jan 17 02:41:15.706815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 476/987] 10.222.0.24 () {60 vars in 1157 bytes} [Mon Jan 17 02:41:14 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:41:15.802530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1997713247", "imageRef": "61784d1a-1e36-49eb-b6a6-2ce2a06db572", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1708365876", "networks": [{"uuid": "f1ab6242-6ca5-4ff0-9d8f-51b0841ba34d"}]}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:15.855814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] validate_networks() for [('f1ab6242-6ca5-4ff0-9d8f-51b0841ba34d', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:41:16.224847 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:41:16.225266 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:41:16.225897 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:41:16.226336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:41:16.226807 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:41:16.235461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:16.236046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:16.236893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:16.237330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:16.254464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Getting quotas for project 64e093625bec4998bc4012524037d1eb. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:41:16.258358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Getting quotas for user 84b0b72a72a148d6bd409a7a4afd81c7 and project 64e093625bec4998bc4012524037d1eb. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:41:16.269225 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:41:16.271493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='61784d1a-1e36-49eb-b6a6-2ce2a06db572',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:41:16.317795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-884fcb21-531c-4ecb-bdad-4e8dd5b56bda tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518960 Jan 17 02:41:16.321687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 512/988] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:41:16.328456 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-45da2283-2ecd-4b3a-bb42-bb2f749aab2a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:16.329060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-45da2283-2ecd-4b3a-bb42-bb2f749aab2a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:16.381655 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-45da2283-2ecd-4b3a-bb42-bb2f749aab2a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:16.388932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-45da2283-2ecd-4b3a-bb42-bb2f749aab2a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1259 microversion: 2.1 time: 0.064517 Jan 17 02:41:16.389589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 477/989] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:16 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:16.688934 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:16.689626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:16.696212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:16.696923 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:16.698229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:16.698666 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:16.835999 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:16.844659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9374ded1-de44-45ad-91e4-ce44aab70116 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.159963 Jan 17 02:41:16.845255 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 513/990] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:16 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:17.408675 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:17.409326 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:17.416344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:17.417786 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:17.418870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:17.419479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:17.504486 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:17.513081 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f289abfd-2741-444a-a5c4-b82e631274fc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1319 microversion: 2.1 time: 0.111060 Jan 17 02:41:17.513652 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 478/991] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:17 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1319 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:17.862020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:17.862616 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:17.869342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:17.870025 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:17.870994 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:17.872296 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:18.096401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:18.105288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1708478b-24e1-4dd7-971d-e00fd934c90d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.247016 Jan 17 02:41:18.105862 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 514/992] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:17 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:18.530558 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:18.531877 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:18.539353 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:18.545629 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:18.546660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:18.548019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:18.705508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:18.713920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-97ade1a9-8ba9-49c0-a51d-36a5cb9ec919 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.187582 Jan 17 02:41:18.714717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 479/993] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:18 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:19.124412 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:19.125886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:19.132936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:19.133587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:19.134656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:19.135096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:19.295035 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:19.303185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-591c157a-0dd2-4c9f-a824-604c595d9cfd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.182923 Jan 17 02:41:19.303851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 515/994] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:19 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:19.732248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:19.733620 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:19.740603 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:19.741061 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:19.741858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:19.742291 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:19.895762 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:19.912520 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-206d4589-6b18-44b9-b3a7-e47b6c4ed0e2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.184865 Jan 17 02:41:19.913249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 480/995] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:19 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:20.322907 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:20.324707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:20.331688 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:20.332494 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:20.333349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:20.333845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:20.470973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:20.478642 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-38957895-e578-4f8c-a6a7-d53f417e7b5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.161197 Jan 17 02:41:20.479217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 516/996] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:20 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:20.929478 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:20.930751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:20.937358 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:20.938128 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:20.938882 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:20.939536 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:21.082345 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:21.090732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-36743d34-c932-4eb8-9489-20f3863135d3 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.164848 Jan 17 02:41:21.091427 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 481/997] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:20 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:21.496759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:21.497442 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:21.504651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:21.505636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:21.506682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:21.507455 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:21.688945 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:21.697242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dd328022-34aa-4622-aac4-7ca982853c5a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.204293 Jan 17 02:41:21.697842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 517/998] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:21 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:22.107606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:22.108410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:22.116346 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:22.117316 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:22.118340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:22.118938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:22.282072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:22.291151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4fcf6f7f-7ea4-4f7a-80b6-0d739708f80f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.187603 Jan 17 02:41:22.294072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 482/999] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:22 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:22.714927 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:22.715752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:22.723510 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:22.723979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:22.724825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:22.725314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:22.859573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:22.867202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9cb46114-6c75-4949-8992-5b87f2330785 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.156221 Jan 17 02:41:22.867780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 518/1000] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:22 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:23.308328 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:23.309033 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:23.315583 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:23.316032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:23.316956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:23.317570 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:23.458631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:23.466699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d6434c3b-ee1e-489d-8a46-b6578c7ab175 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.162294 Jan 17 02:41:23.467463 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 483/1001] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:23 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:23.883609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:23.884398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:23.890897 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:23.891351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:23.892171 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:23.892614 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:24.026401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:24.034404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-58f13a54-e2e9-45c6-99d3-d82038cb8752 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.154508 Jan 17 02:41:24.035045 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 519/1002] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:23 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:24.482822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:24.483425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:24.490305 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:24.490810 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:24.491616 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:24.492076 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:24.624127 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:24.631974 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a7b316c4-8577-44ab-a0b5-a164eeffaeae tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.152695 Jan 17 02:41:24.640774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 484/1003] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:24 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:25.051467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:25.052229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:25.059592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:25.060110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:25.060909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:25.061347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:25.232590 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:25.240152 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b2bbb6f2-a872-4157-9f9b-00df953c071d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.192486 Jan 17 02:41:25.240802 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 520/1004] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:25 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:25.650131 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:25.651093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:25.658748 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:25.659381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:25.660168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:25.660635 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:25.798510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:25.806190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bdf4be5f-4c2f-491d-9e52-10229ede64c9 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.160833 Jan 17 02:41:25.806969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 485/1005] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:25 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:26.257357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:26.258074 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:26.264682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:26.265052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:26.265841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:26.266266 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:26.403534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:26.411239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-956994dc-b9d4-4dad-a954-0b0772bd099a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.157616 Jan 17 02:41:26.411799 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 521/1006] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:26 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:26.826821 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:26.827743 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:26.837272 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:26.837729 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:26.838517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:26.838954 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:26.969520 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:26.976851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e6a01403-8bb6-40c9-8c50-b068c40b3eca tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.156458 Jan 17 02:41:26.977458 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 486/1007] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:26 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:27.429114 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:27.429756 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:27.436441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:27.436899 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:27.437685 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:27.438125 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:27.577305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:27.586402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ee8a638a-b4b3-4f81-9472-f7be6e14ea20 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.161190 Jan 17 02:41:27.586996 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 522/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:27 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:27.995842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:27.996641 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:28.005323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:28.005924 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:28.007069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:28.007509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:28.139699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:28.149985 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8da1a03e-bbcb-4ae8-9370-5d182a065541 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.159201 Jan 17 02:41:28.150556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 487/1009] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:27 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:28.603840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:28.604477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:28.611262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:28.611804 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:28.612550 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:28.612993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:28.755349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:28.763424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-91256540-f43e-4f0c-bf53-09781ea35fdb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1677 microversion: 2.1 time: 0.163800 Jan 17 02:41:28.764003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 523/1010] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:28 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:29.171102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:29.172020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:29.181480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:29.181933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:29.182721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:29.183158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:29.319625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:29.326931 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-63098c27-750e-4122-ae92-db2ff5c5abe8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.161971 Jan 17 02:41:29.327492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 488/1011] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:29 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:29.780650 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:29.781545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:29.790226 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:29.790794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:29.792284 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:29.792869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:30.007719 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:30.015268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b3c019f5-4615-40ad-b56b-d4e0ccac4b85 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1654 microversion: 2.1 time: 0.238816 Jan 17 02:41:30.015777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 524/1012] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:29 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1654 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:30.031914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-56a58457-9f89-48d2-a3d3-c03f92983c45 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:30.037882 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-56a58457-9f89-48d2-a3d3-c03f92983c45 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:30.038366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-56a58457-9f89-48d2-a3d3-c03f92983c45 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:30.060575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-56a58457-9f89-48d2-a3d3-c03f92983c45 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Going to try to start instance {{(pid=122782) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 17 02:41:30.112895 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-56a58457-9f89-48d2-a3d3-c03f92983c45 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action" status: 202 len: 0 microversion: 2.1 time: 0.084817 Jan 17 02:41:30.116541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 489/1013] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:41:30 2022] POST /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:41:30.128964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:30.129834 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:30.137478 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-e2300cd6-2b95-4786-8ea2-a2e87c76f3d1 req-cd2fd454-09e6-4e83-b084-311228466196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e84400-8d07-4d52-a0af-fe7faf22466e", "tag": "6165ac27-1cf4-4f9d-b4a0-390a637a75d1"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:30.140248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:41:30.140248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:41:30.140581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:30.140939 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:30.141888 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:30.142318 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:30.152272 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e2300cd6-2b95-4786-8ea2-a2e87c76f3d1 req-cd2fd454-09e6-4e83-b084-311228466196 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:30.153067 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e2300cd6-2b95-4786-8ea2-a2e87c76f3d1 req-cd2fd454-09e6-4e83-b084-311228466196 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:30.171378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-e2300cd6-2b95-4786-8ea2-a2e87c76f3d1 req-cd2fd454-09e6-4e83-b084-311228466196 service nova] Creating event network-changed:6165ac27-1cf4-4f9d-b4a0-390a637a75d1 for instance 06e84400-8d07-4d52-a0af-fe7faf22466e on hv-cinder-82160 Jan 17 02:41:30.175968 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-e2300cd6-2b95-4786-8ea2-a2e87c76f3d1 req-cd2fd454-09e6-4e83-b084-311228466196 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045215 Jan 17 02:41:30.177020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 490/1014] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:41:30.337281 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:30.344471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:30.345172 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:30.349390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a41587de-c1fe-4495-8806-880be6ad40b0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1663 microversion: 2.1 time: 0.230176 Jan 17 02:41:30.350618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 525/1015] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:30 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1663 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:30.352270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:30.352730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:30.353531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:30.353971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:30.547286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:30.555240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7ad5ac61-c20a-4b8a-8a27-1f8585016cab tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.214829 Jan 17 02:41:30.556647 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 491/1016] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:30 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:41:31.367085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:31.367780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:31.374466 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:31.374856 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:31.375639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:31.376109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:31.507142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:31.514665 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1a25875d-ba5a-4f3c-8a19-cf42d573f4ab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1663 microversion: 2.1 time: 0.151569 Jan 17 02:41:31.515215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 526/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:31 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:31.572422 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:31.572989 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:31.579715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:31.580198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:31.580983 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:31.581409 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:31.717183 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:31.726432 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-20987b60-5c3a-457e-a18b-ebeae2df972f tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.157689 Jan 17 02:41:31.729667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 492/1018] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:31 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:32.538766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:32.539432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:32.547613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:32.548234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:32.549218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:32.549764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:32.691307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:32.699380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-77e90329-37f2-4a7c-bbff-de737b2d0840 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1667 microversion: 2.1 time: 0.167143 Jan 17 02:41:32.699981 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 527/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:32 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:32.745192 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:32.746088 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:32.755984 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:32.756740 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:32.757967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:32.758638 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:32.897093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:32.905577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ba1c5051-21c7-4f6d-b6e7-d3cae6457b89 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.165479 Jan 17 02:41:32.906154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 493/1020] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:32 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:33.930464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:33.931306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:33.942136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:33.942922 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:33.944237 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:33.944941 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:34.348007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:34.355525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9fb8730b-d6ba-4b8f-bbd7-aa8825267b14 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.431402 Jan 17 02:41:34.356272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 528/1021] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:33 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:35.373351 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:35.373942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:35.381194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:35.381659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:35.382588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:35.383062 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:35.512395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:35.520195 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2d94afeb-e02e-4ad4-b543-c652f6d76b85 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.151111 Jan 17 02:41:35.520779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 494/1022] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:35 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:36.345762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-257db8e2-797b-48cf-ad42-59f551b907fe req-7b1865c9-5877-4cee-a465-fb5f6d83b445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e84400-8d07-4d52-a0af-fe7faf22466e", "name": "network-vif-plugged", "status": "completed", "tag": "6165ac27-1cf4-4f9d-b4a0-390a637a75d1"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:36.347828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:41:36.347828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:41:36.357104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-257db8e2-797b-48cf-ad42-59f551b907fe req-7b1865c9-5877-4cee-a465-fb5f6d83b445 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:36.357721 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-257db8e2-797b-48cf-ad42-59f551b907fe req-7b1865c9-5877-4cee-a465-fb5f6d83b445 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:36.369849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-257db8e2-797b-48cf-ad42-59f551b907fe req-7b1865c9-5877-4cee-a465-fb5f6d83b445 service nova] Creating event network-vif-plugged:6165ac27-1cf4-4f9d-b4a0-390a637a75d1 for instance 06e84400-8d07-4d52-a0af-fe7faf22466e on hv-cinder-82160 Jan 17 02:41:36.374803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-257db8e2-797b-48cf-ad42-59f551b907fe req-7b1865c9-5877-4cee-a465-fb5f6d83b445 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Jan 17 02:41:36.375387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 529/1023] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:41:36.536455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:36.537097 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:36.543408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:36.543841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:36.544657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:36.545088 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:36.730693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:36.738497 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a44eb09e-4fd6-448a-a9c1-00aeef21805e tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.205873 Jan 17 02:41:36.739101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 495/1024] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:36 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:37.759308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:37.760301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:37.767555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:37.768027 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:37.768877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:37.769328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:37.901252 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:37.909748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-855b0582-597d-4fe5-9409-2e0109e492d8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1359 microversion: 2.1 time: 0.157104 Jan 17 02:41:37.910314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 530/1025] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:37 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:38.927761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:38.928374 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:38.935087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:38.935534 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:38.936379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:38.936789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:39.177535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:39.185214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b920804f-d574-483a-b0d2-b2d47a01f2c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1550 microversion: 2.1 time: 0.261156 Jan 17 02:41:39.185778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 496/1026] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:38 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1550 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:39.201299 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:39.201909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:39.208667 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:39.209118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:39.209885 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:39.210348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:39.396471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:39.404262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-075541c9-7e64-4432-a12b-963fca9ef1f5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1550 microversion: 2.1 time: 0.206756 Jan 17 02:41:39.404853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 531/1027] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:39 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1550 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:39.419832 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:39.423210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:41:39.423210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:41:39.424221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:39.424964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Searching by: {'deleted': False, 'project_id': '64e093625bec4998bc4012524037d1eb'} {{(pid=122782) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 17 02:41:39.431573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:39.432033 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:39.432857 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:39.433371 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:39.520340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.multi_cell_list [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122782) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 17 02:41:39.614513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9985ff80-3b32-47cb-9475-e2968e47beaa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198179 Jan 17 02:41:39.615090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 497/1028] 10.222.0.24 () {58 vars in 1124 bytes} [Mon Jan 17 02:41:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:41:39.625432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:39.626089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:39.632610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:39.632610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:39.633293 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:39.633727 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:39.765970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:39.773574 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8a83ce7f-48d6-44cf-8a0c-064d9972edb1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1550 microversion: 2.1 time: 0.151837 Jan 17 02:41:39.774132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 532/1029] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:39 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:41.310341 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2e7c6505-0a72-42bc-8f6c-ba4c6fb7f6ec tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8db416b0-3017-4434-8868-45bcf6ae9490"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:41.311857 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2e7c6505-0a72-42bc-8f6c-ba4c6fb7f6ec tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:41.320399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e7c6505-0a72-42bc-8f6c-ba4c6fb7f6ec tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:41.320849 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e7c6505-0a72-42bc-8f6c-ba4c6fb7f6ec tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:41.321632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e7c6505-0a72-42bc-8f6c-ba4c6fb7f6ec tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:41.322059 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e7c6505-0a72-42bc-8f6c-ba4c6fb7f6ec tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:41.580282 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2e7c6505-0a72-42bc-8f6c-ba4c6fb7f6ec tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276016 Jan 17 02:41:41.580920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 498/1030] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:41:41 2022] POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:41:49.166540 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:49.167525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:49.175051 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:49.175507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:49.176342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:49.176785 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:49.315490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:49.323883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ea401f30-6e6d-445e-ad75-d01912bd87e7 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1596 microversion: 2.1 time: 0.163532 Jan 17 02:41:49.324454 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 533/1031] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:49 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1596 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:50.069456 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4368cf4c-afbe-4996-a777-3f2e26b850a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:50.070049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4368cf4c-afbe-4996-a777-3f2e26b850a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:50.076730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4368cf4c-afbe-4996-a777-3f2e26b850a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:50.077173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4368cf4c-afbe-4996-a777-3f2e26b850a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:50.077955 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4368cf4c-afbe-4996-a777-3f2e26b850a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:50.078419 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4368cf4c-afbe-4996-a777-3f2e26b850a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:50.107450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4368cf4c-afbe-4996-a777-3f2e26b850a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments/7ad75462-0847-4462-8e23-00c68dfdf958" status: 200 len: 194 microversion: 2.20 time: 0.042965 Jan 17 02:41:50.108050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 499/1032] 10.222.0.24 () {60 vars in 1453 bytes} [Mon Jan 17 02:41:50 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments/7ad75462-0847-4462-8e23-00c68dfdf958 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:41:50.173129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:50.173657 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:50.180227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:50.180675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:50.181503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:50.181930 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:50.258943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lazy-loading 'services' on Instance uuid d7e3840c-9200-4dfe-8879-42d7cd878ec1 {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:41:50.332328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9b302e65-5961-496f-9614-86f4af8281c3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments/7ad75462-0847-4462-8e23-00c68dfdf958" status: 202 len: 0 microversion: 2.20 time: 0.162868 Jan 17 02:41:50.333250 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 534/1033] 10.222.0.24 () {60 vars in 1456 bytes} [Mon Jan 17 02:41:50 2022] DELETE /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments/7ad75462-0847-4462-8e23-00c68dfdf958 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:41:50.341997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-03d7488f-718b-4514-9c23-505176abe0b5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:50.342993 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-03d7488f-718b-4514-9c23-505176abe0b5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:50.350316 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03d7488f-718b-4514-9c23-505176abe0b5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:50.350817 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03d7488f-718b-4514-9c23-505176abe0b5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:50.351675 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03d7488f-718b-4514-9c23-505176abe0b5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:50.352162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-03d7488f-718b-4514-9c23-505176abe0b5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:50.384250 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-03d7488f-718b-4514-9c23-505176abe0b5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046825 Jan 17 02:41:50.384815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 500/1034] 10.222.0.24 () {60 vars in 1342 bytes} [Mon Jan 17 02:41:50 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:41:51.133167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-97d2cce1-9ccb-4b2e-81db-2f77f0ee760c req-05263bd4-ced9-4716-818d-46e82b7c3e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e84400-8d07-4d52-a0af-fe7faf22466e", "tag": "6165ac27-1cf4-4f9d-b4a0-390a637a75d1"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:51.134676 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:41:51.134676 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:41:51.142161 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-97d2cce1-9ccb-4b2e-81db-2f77f0ee760c req-05263bd4-ced9-4716-818d-46e82b7c3e6b service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:51.142715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-97d2cce1-9ccb-4b2e-81db-2f77f0ee760c req-05263bd4-ced9-4716-818d-46e82b7c3e6b service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:51.156810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-97d2cce1-9ccb-4b2e-81db-2f77f0ee760c req-05263bd4-ced9-4716-818d-46e82b7c3e6b service nova] Creating event network-changed:6165ac27-1cf4-4f9d-b4a0-390a637a75d1 for instance 06e84400-8d07-4d52-a0af-fe7faf22466e on hv-cinder-82160 Jan 17 02:41:51.162582 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-97d2cce1-9ccb-4b2e-81db-2f77f0ee760c req-05263bd4-ced9-4716-818d-46e82b7c3e6b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033376 Jan 17 02:41:51.164656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 535/1035] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:41:51.396225 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-27864d0d-7583-424b-b67d-21c41b2d767d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:51.397128 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-27864d0d-7583-424b-b67d-21c41b2d767d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:51.404007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27864d0d-7583-424b-b67d-21c41b2d767d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:51.404575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27864d0d-7583-424b-b67d-21c41b2d767d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:51.405366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27864d0d-7583-424b-b67d-21c41b2d767d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:51.406020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27864d0d-7583-424b-b67d-21c41b2d767d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:51.436949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-27864d0d-7583-424b-b67d-21c41b2d767d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044592 Jan 17 02:41:51.442618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 501/1036] 10.222.0.24 () {60 vars in 1342 bytes} [Mon Jan 17 02:41:51 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:51.497100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:51.498679 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:51.505294 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:51.505744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:51.506526 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:51.507276 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:51.535741 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:41:51.626767 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-17564648-847c-4aa3-b3ff-0ddb79675269 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 204 len: 0 microversion: 2.20 time: 0.133591 Jan 17 02:41:51.627386 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 536/1037] 10.222.0.24 () {60 vars in 1279 bytes} [Mon Jan 17 02:41:51 2022] DELETE /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 02:41:51.635671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:51.636723 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:51.642746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:51.643395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:51.644240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:51.644682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:51.929704 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:51.938959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:51.940494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:51.941811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d9e1facd-02c8-4db3-8a62-dce102251163 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.309945 Jan 17 02:41:51.942516 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 502/1038] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:41:51 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:41:52.434447 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1476057176"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:52.435271 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:52.441576 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:52.442105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:52.443117 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:52.443627 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:52.579529 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.network.security_group_api [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Adding security group 8671b338-c404-47bf-a75a-7688dab5fc46 to port 6165ac27-1cf4-4f9d-b4a0-390a637a75d1 Jan 17 02:41:52.924038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-baa55e61-fef8-4fd3-be9c-96320086156b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/action" status: 202 len: 0 microversion: 2.1 time: 0.493741 Jan 17 02:41:52.924750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 537/1039] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:41:52 2022] POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:41:52.934760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:52.936090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:52.944141 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:52.944746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:52.951116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:52.951699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:52.960601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:52.961412 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:52.968047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:52.968714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:52.969472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:52.969916 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:53.204944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:53.212060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:53.214068 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:53.216010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:53.217430 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4d52bd2c-5d2a-4fb6-bba6-be594a9f3d9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.260886 Jan 17 02:41:53.218347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 538/1040] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:41:52 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:41:53.223287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-635b96a3-e86a-4d15-a384-e484ae1a5c17 req-267471c9-8638-44e9-a481-a55b44be5462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e84400-8d07-4d52-a0af-fe7faf22466e", "tag": "6165ac27-1cf4-4f9d-b4a0-390a637a75d1"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:53.224877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:41:53.224877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:41:53.226031 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ec4ee89e-efdc-4885-aa44-d1afba56e2c1 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1761 microversion: 2.1 time: 0.296953 Jan 17 02:41:53.231407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 503/1041] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:41:52 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1761 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:41:53.233047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-635b96a3-e86a-4d15-a384-e484ae1a5c17 req-267471c9-8638-44e9-a481-a55b44be5462 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:53.233558 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-635b96a3-e86a-4d15-a384-e484ae1a5c17 req-267471c9-8638-44e9-a481-a55b44be5462 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:53.250438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-635b96a3-e86a-4d15-a384-e484ae1a5c17 req-267471c9-8638-44e9-a481-a55b44be5462 service nova] Creating event network-changed:6165ac27-1cf4-4f9d-b4a0-390a637a75d1 for instance 06e84400-8d07-4d52-a0af-fe7faf22466e on hv-cinder-82160 Jan 17 02:41:53.256237 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-635b96a3-e86a-4d15-a384-e484ae1a5c17 req-267471c9-8638-44e9-a481-a55b44be5462 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036384 Jan 17 02:41:53.256841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 539/1042] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:41:54.237212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:54.237788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:54.245270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:54.245466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:54.246285 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:54.246748 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:54.386401 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:54.394532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:54.395997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:54.397164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4d07da46-1b0d-4ffd-b592-d9fa8e4867e8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1723 microversion: 2.20 time: 0.163862 Jan 17 02:41:54.397715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 504/1043] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:41:54 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:41:55.067018 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-f78f0be9-5325-4f94-8f94-3e24e519ba4b req-21c39fdc-62f1-4efa-affd-44d26ccb58f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e3840c-9200-4dfe-8879-42d7cd878ec1", "name": "network-vif-deleted", "tag": "c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:55.068584 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:41:55.068584 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:41:55.086346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-f78f0be9-5325-4f94-8f94-3e24e519ba4b req-21c39fdc-62f1-4efa-affd-44d26ccb58f4 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:55.086781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-f78f0be9-5325-4f94-8f94-3e24e519ba4b req-21c39fdc-62f1-4efa-affd-44d26ccb58f4 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:55.099724 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-f78f0be9-5325-4f94-8f94-3e24e519ba4b req-21c39fdc-62f1-4efa-affd-44d26ccb58f4 service nova] Creating event network-vif-deleted:c84e2cbd-c5ac-4b4f-822b-d7d9be3f225a for instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 on hv-cinder-82160 Jan 17 02:41:55.105857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-f78f0be9-5325-4f94-8f94-3e24e519ba4b req-21c39fdc-62f1-4efa-affd-44d26ccb58f4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179019 Jan 17 02:41:55.106734 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 540/1044] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:41:55.416335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:55.416942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:55.423913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:55.424410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:55.425258 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:55.425697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:55.460517 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:55.461225 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:55.461899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lazy-loading 'fault' on Instance uuid d7e3840c-9200-4dfe-8879-42d7cd878ec1 {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:41:55.503905 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:55.512545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:55.514073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:55.515251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8eab2ded-5bc3-4780-8ee2-efa19376c2eb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 200 len: 1371 microversion: 2.20 time: 0.103042 Jan 17 02:41:55.526300 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 505/1045] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:41:55 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:41:56.535215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:56.535858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:56.542937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:56.543390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:56.544217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:56.544736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:56.558190 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] HTTP exception thrown: Instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 could not be found. Jan 17 02:41:56.558778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Returning 404 to user: Instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:41:56.559602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4af8ac51-db54-4a95-9767-0ef3a75ff442 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 404 len: 111 microversion: 2.20 time: 0.029067 Jan 17 02:41:56.560187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 541/1046] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:41:56 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:41:56.568699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dc688193-ceb4-4399-8e97-b1b0bfe944a5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '.version_select at 0x7f074dd8f160>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:56.588168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dc688193-ceb4-4399-8e97-b1b0bfe944a5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-434689752" status: 204 len: 0 microversion: 2.20 time: 0.023049 Jan 17 02:41:56.588751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 506/1047] 10.222.0.24 () {60 vars in 1258 bytes} [Mon Jan 17 02:41:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-434689752 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 02:41:57.284583 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ed7bfce5-619b-42d4-a128-ba937d57b3a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'create', calling method: .version_select at 0x7f074dcf7550>, body: {"keypair": {"name": "tempest-keypair-1564238477"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:57.298469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-ed7bfce5-619b-42d4-a128-ba937d57b3a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:41:57.302484 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-ed7bfce5-619b-42d4-a128-ba937d57b3a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for user b97e9255c61a4c9fb57f59fb657a46b8 and project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:41:57.378833 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-ed7bfce5-619b-42d4-a128-ba937d57b3a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:41:57.382466 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-ed7bfce5-619b-42d4-a128-ba937d57b3a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for user b97e9255c61a4c9fb57f59fb657a46b8 and project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:41:57.397572 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ed7bfce5-619b-42d4-a128-ba937d57b3a7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.116695 Jan 17 02:41:57.398096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 542/1048] 10.222.0.24 () {62 vars in 1198 bytes} [Mon Jan 17 02:41:57 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 17 02:41:58.726171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-174459310", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8338e3ec-35ae-45c9-9027-5a5ad4414b55"}], "security_groups": [{"name": "tempest-securitygroup--2044583966"}], "key_name": "tempest-keypair-1564238477", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:41:58.832330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] validate_networks() for [('8338e3ec-35ae-45c9-9027-5a5ad4414b55', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:41:59.257373 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:41:59.257972 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:41:59.258664 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:41:59.259229 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:41:59.259807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:41:59.269670 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:59.270048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:59.271253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:41:59.271840 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:41:59.292315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:41:59.297418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Getting quotas for user b97e9255c61a4c9fb57f59fb657a46b8 and project 0e6a07fd918d456ea8cae8d52b172382. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:41:59.313489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:41:59.315936 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:41:59.367212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-038778e6-2d66-4b27-b876-90dcd83f055e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.645766 Jan 17 02:41:59.373226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 507/1049] 10.222.0.24 () {62 vars in 1187 bytes} [Mon Jan 17 02:41:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 17 02:41:59.378329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b5f55479-b3be-419b-b1a9-293d3110bda7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:41:59.378956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b5f55479-b3be-419b-b1a9-293d3110bda7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:41:59.440772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b5f55479-b3be-419b-b1a9-293d3110bda7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:59.448826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b5f55479-b3be-419b-b1a9-293d3110bda7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:59.450312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b5f55479-b3be-419b-b1a9-293d3110bda7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:41:59.451417 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b5f55479-b3be-419b-b1a9-293d3110bda7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1281 microversion: 2.20 time: 0.077043 Jan 17 02:41:59.451950 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 543/1050] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:41:59 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:00.470752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:00.472054 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:00.479012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:00.479506 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:00.480342 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:00.480975 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:00.542527 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:00.551465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:00.553226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:00.554573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8b5c5ff1-e310-408f-ade4-af11b7603b5e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1351 microversion: 2.20 time: 0.088524 Jan 17 02:42:00.556767 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 508/1051] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:00 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:01.574539 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:01.575401 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:01.582517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:01.583134 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:01.584209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:01.584878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:01.732123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:01.740259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:01.741763 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:01.743001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6964a4ee-46a4-4afb-bbf9-6269faf55047 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1407 microversion: 2.20 time: 0.173430 Jan 17 02:42:01.743638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 544/1052] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:01 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:01.769264 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-838bb32f-1231-4377-b649-016fa280f75e req-0a907a1a-460f-44f1-b0fb-e3f9b905dae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834bc0c3-4bde-484a-8d9b-aab060aac09b", "tag": "8e033a10-4ded-4f31-af25-ef0b393110ad"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:01.771176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:01.771176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:42:01.782778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-838bb32f-1231-4377-b649-016fa280f75e req-0a907a1a-460f-44f1-b0fb-e3f9b905dae0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:01.783244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-838bb32f-1231-4377-b649-016fa280f75e req-0a907a1a-460f-44f1-b0fb-e3f9b905dae0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:01.794650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-838bb32f-1231-4377-b649-016fa280f75e req-0a907a1a-460f-44f1-b0fb-e3f9b905dae0 service nova] Creating event network-changed:8e033a10-4ded-4f31-af25-ef0b393110ad for instance 834bc0c3-4bde-484a-8d9b-aab060aac09b on hv-cinder-82160 Jan 17 02:42:01.800322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-838bb32f-1231-4377-b649-016fa280f75e req-0a907a1a-460f-44f1-b0fb-e3f9b905dae0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034183 Jan 17 02:42:01.801253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 509/1053] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:42:02.761635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:02.762198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:02.769151 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:02.769604 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:02.770388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:02.770805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:02.901311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:02.909689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:02.911164 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:02.912294 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5952044d-3bb7-43fa-9bec-f029d48a7345 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1407 microversion: 2.20 time: 0.154420 Jan 17 02:42:02.912853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 545/1054] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:02 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:03.935685 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:03.936737 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:03.943451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:03.943898 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:03.944704 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:03.945134 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:04.079115 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:04.087268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:04.088894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:04.089990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-34d1521e-f2de-4fea-816d-0b2ebce8774b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1407 microversion: 2.20 time: 0.161899 Jan 17 02:42:04.090523 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 510/1055] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:03 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:05.107484 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:05.108473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:05.115272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:05.115754 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:05.116581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:05.117090 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:05.249872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:05.258219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:05.259718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:05.260841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ccb71b7a-4ed9-4083-a6e1-2bee2a3eb70e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1407 microversion: 2.20 time: 0.157201 Jan 17 02:42:05.261394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 546/1056] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:05 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:06.279226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:06.279830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:06.286573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:06.287022 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:06.287807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:06.288283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:06.425633 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:06.434074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:06.435481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:06.436609 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-12306ea6-b124-47a8-b60f-ac48edcaeba6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1407 microversion: 2.20 time: 0.161585 Jan 17 02:42:06.437173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 511/1057] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:06 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:06.495067 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-56dd19a8-bf6a-4be5-9c76-82dd42303580 req-3899912f-0a94-4cee-99d6-c8ccbd58dda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834bc0c3-4bde-484a-8d9b-aab060aac09b", "name": "network-vif-plugged", "status": "completed", "tag": "8e033a10-4ded-4f31-af25-ef0b393110ad"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:06.496618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:06.496618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:42:06.504267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-56dd19a8-bf6a-4be5-9c76-82dd42303580 req-3899912f-0a94-4cee-99d6-c8ccbd58dda7 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:06.504746 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-56dd19a8-bf6a-4be5-9c76-82dd42303580 req-3899912f-0a94-4cee-99d6-c8ccbd58dda7 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:06.515943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-56dd19a8-bf6a-4be5-9c76-82dd42303580 req-3899912f-0a94-4cee-99d6-c8ccbd58dda7 service nova] Creating event network-vif-plugged:8e033a10-4ded-4f31-af25-ef0b393110ad for instance 834bc0c3-4bde-484a-8d9b-aab060aac09b on hv-cinder-82160 Jan 17 02:42:06.521099 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-56dd19a8-bf6a-4be5-9c76-82dd42303580 req-3899912f-0a94-4cee-99d6-c8ccbd58dda7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029727 Jan 17 02:42:06.521894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 547/1058] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:07.454899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:07.455595 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:07.462273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:07.462724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:07.463498 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:07.463943 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:07.597719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:07.609018 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:07.610627 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:07.611952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a7e9a49d-f5d1-40a8-9f0a-eecd85b6b8ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1407 microversion: 2.20 time: 0.160862 Jan 17 02:42:07.612552 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 512/1059] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:07 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:08.633674 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:08.634537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:08.641198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:08.641655 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:08.642443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:08.642860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:08.780869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:08.789140 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:08.790622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:08.791768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1804e54a-6a23-4322-ae61-7d28cd39e5ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1600 microversion: 2.20 time: 0.162722 Jan 17 02:42:08.792440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 548/1060] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:42:08 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:08.813730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a61d603c-c6a6-4c84-9920-8266df93958b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:08.814268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a61d603c-c6a6-4c84-9920-8266df93958b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:08.823528 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a61d603c-c6a6-4c84-9920-8266df93958b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:08.824096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a61d603c-c6a6-4c84-9920-8266df93958b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:08.825219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a61d603c-c6a6-4c84-9920-8266df93958b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:08.825815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a61d603c-c6a6-4c84-9920-8266df93958b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:08.910079 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a61d603c-c6a6-4c84-9920-8266df93958b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100566 Jan 17 02:42:08.910841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 513/1061] 10.222.0.24 () {60 vars in 1315 bytes} [Mon Jan 17 02:42:08 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:42:09.883431 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d609a25f-238c-4a31-bc37-f0d8af90fa44 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:09.884433 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d609a25f-238c-4a31-bc37-f0d8af90fa44 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:09.885417 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-d93d07ae-4c57-400f-88ad-2dc4d8cea06c req-c0e01d69-12c0-448b-a9a0-1293322de28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834bc0c3-4bde-484a-8d9b-aab060aac09b", "tag": "8e033a10-4ded-4f31-af25-ef0b393110ad"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:09.887322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:09.887322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:42:09.891698 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d609a25f-238c-4a31-bc37-f0d8af90fa44 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:09.892238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d609a25f-238c-4a31-bc37-f0d8af90fa44 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:09.893475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d609a25f-238c-4a31-bc37-f0d8af90fa44 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:09.893905 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d609a25f-238c-4a31-bc37-f0d8af90fa44 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:09.894932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-d93d07ae-4c57-400f-88ad-2dc4d8cea06c req-c0e01d69-12c0-448b-a9a0-1293322de28d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:09.895430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-d93d07ae-4c57-400f-88ad-2dc4d8cea06c req-c0e01d69-12c0-448b-a9a0-1293322de28d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:09.907288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-d93d07ae-4c57-400f-88ad-2dc4d8cea06c req-c0e01d69-12c0-448b-a9a0-1293322de28d service nova] Creating event network-changed:8e033a10-4ded-4f31-af25-ef0b393110ad for instance 834bc0c3-4bde-484a-8d9b-aab060aac09b on hv-cinder-82160 Jan 17 02:42:09.912512 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-d93d07ae-4c57-400f-88ad-2dc4d8cea06c req-c0e01d69-12c0-448b-a9a0-1293322de28d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031010 Jan 17 02:42:09.913580 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 514/1062] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:10.003948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d609a25f-238c-4a31-bc37-f0d8af90fa44 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.124091 Jan 17 02:42:10.004592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 549/1063] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:09 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:11.015962 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-36db1456-428f-4483-8bdb-fedc9299e453 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:11.016991 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-36db1456-428f-4483-8bdb-fedc9299e453 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:11.023632 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36db1456-428f-4483-8bdb-fedc9299e453 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:11.024100 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36db1456-428f-4483-8bdb-fedc9299e453 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:11.024898 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36db1456-428f-4483-8bdb-fedc9299e453 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:11.025335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-36db1456-428f-4483-8bdb-fedc9299e453 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:11.108644 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-36db1456-428f-4483-8bdb-fedc9299e453 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.096778 Jan 17 02:42:11.109575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 515/1064] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:11 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:12.125603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-eda7c5d9-b1c6-4d97-a8e3-f54282ed71c0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:12.127176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-eda7c5d9-b1c6-4d97-a8e3-f54282ed71c0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:12.138706 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eda7c5d9-b1c6-4d97-a8e3-f54282ed71c0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:12.139464 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eda7c5d9-b1c6-4d97-a8e3-f54282ed71c0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:12.140803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eda7c5d9-b1c6-4d97-a8e3-f54282ed71c0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:12.141528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eda7c5d9-b1c6-4d97-a8e3-f54282ed71c0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:12.232924 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-eda7c5d9-b1c6-4d97-a8e3-f54282ed71c0 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.113648 Jan 17 02:42:12.233920 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 550/1065] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:12 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:13.250858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-50cc5f8b-e12b-4c4c-aa44-b5605536360f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:13.252480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-50cc5f8b-e12b-4c4c-aa44-b5605536360f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:13.259767 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50cc5f8b-e12b-4c4c-aa44-b5605536360f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:13.260240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50cc5f8b-e12b-4c4c-aa44-b5605536360f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:13.261017 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50cc5f8b-e12b-4c4c-aa44-b5605536360f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:13.261445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-50cc5f8b-e12b-4c4c-aa44-b5605536360f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:13.344442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-50cc5f8b-e12b-4c4c-aa44-b5605536360f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.099860 Jan 17 02:42:13.346600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 516/1066] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:13 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:14.362106 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cea5b4e6-8bb2-4c87-842b-675133bdfaa5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:14.363414 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cea5b4e6-8bb2-4c87-842b-675133bdfaa5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:14.372827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cea5b4e6-8bb2-4c87-842b-675133bdfaa5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:14.373427 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cea5b4e6-8bb2-4c87-842b-675133bdfaa5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:14.374465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cea5b4e6-8bb2-4c87-842b-675133bdfaa5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:14.375039 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cea5b4e6-8bb2-4c87-842b-675133bdfaa5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:14.459816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cea5b4e6-8bb2-4c87-842b-675133bdfaa5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.104412 Jan 17 02:42:14.460478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 551/1067] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:14 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:15.475120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8dd79346-75ec-4cc4-9942-9c7f3f1c4c7f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:15.476220 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8dd79346-75ec-4cc4-9942-9c7f3f1c4c7f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:15.485164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd79346-75ec-4cc4-9942-9c7f3f1c4c7f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:15.485737 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd79346-75ec-4cc4-9942-9c7f3f1c4c7f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:15.487077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd79346-75ec-4cc4-9942-9c7f3f1c4c7f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:15.487729 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8dd79346-75ec-4cc4-9942-9c7f3f1c4c7f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:15.578627 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8dd79346-75ec-4cc4-9942-9c7f3f1c4c7f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.107583 Jan 17 02:42:15.579288 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 517/1068] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:15 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:16.594969 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-16e48f2a-52c0-489f-9409-35f736eab6c8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:16.596553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-16e48f2a-52c0-489f-9409-35f736eab6c8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:16.610291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16e48f2a-52c0-489f-9409-35f736eab6c8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:16.611034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16e48f2a-52c0-489f-9409-35f736eab6c8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:16.612316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16e48f2a-52c0-489f-9409-35f736eab6c8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:16.612776 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-16e48f2a-52c0-489f-9409-35f736eab6c8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:16.700651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-16e48f2a-52c0-489f-9409-35f736eab6c8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.112106 Jan 17 02:42:16.701694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 552/1069] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:16 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:17.718851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f1bbe768-6bca-4205-adab-16bae69734ed tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:17.720566 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f1bbe768-6bca-4205-adab-16bae69734ed tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:17.728170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1bbe768-6bca-4205-adab-16bae69734ed tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:17.728614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1bbe768-6bca-4205-adab-16bae69734ed tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:17.729402 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1bbe768-6bca-4205-adab-16bae69734ed tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:17.729833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f1bbe768-6bca-4205-adab-16bae69734ed tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:17.819482 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f1bbe768-6bca-4205-adab-16bae69734ed tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.106999 Jan 17 02:42:17.820496 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 518/1070] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:17 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:18.838200 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-edd5fa51-05c8-46a1-8ac7-0c5aacd67eba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:18.839852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-edd5fa51-05c8-46a1-8ac7-0c5aacd67eba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:18.851370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edd5fa51-05c8-46a1-8ac7-0c5aacd67eba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:18.852129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edd5fa51-05c8-46a1-8ac7-0c5aacd67eba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:18.853501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edd5fa51-05c8-46a1-8ac7-0c5aacd67eba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:18.854200 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-edd5fa51-05c8-46a1-8ac7-0c5aacd67eba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:18.961949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-edd5fa51-05c8-46a1-8ac7-0c5aacd67eba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.129960 Jan 17 02:42:18.962944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 553/1071] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:18 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:19.980265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d9714ca5-a493-4d7e-9e63-1cdef6b98130 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:19.982520 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d9714ca5-a493-4d7e-9e63-1cdef6b98130 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:19.993983 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9714ca5-a493-4d7e-9e63-1cdef6b98130 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:19.994718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9714ca5-a493-4d7e-9e63-1cdef6b98130 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:19.995995 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9714ca5-a493-4d7e-9e63-1cdef6b98130 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:19.996758 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d9714ca5-a493-4d7e-9e63-1cdef6b98130 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:20.087683 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d9714ca5-a493-4d7e-9e63-1cdef6b98130 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 14 microversion: 2.20 time: 0.113925 Jan 17 02:42:20.088692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 519/1072] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:19 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:21.105604 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4c681873-2e49-4751-83cc-a9f2fec05ad8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:21.107217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4c681873-2e49-4751-83cc-a9f2fec05ad8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:21.119975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c681873-2e49-4751-83cc-a9f2fec05ad8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:21.120466 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c681873-2e49-4751-83cc-a9f2fec05ad8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:21.121247 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c681873-2e49-4751-83cc-a9f2fec05ad8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:21.121682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c681873-2e49-4751-83cc-a9f2fec05ad8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:21.242366 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4c681873-2e49-4751-83cc-a9f2fec05ad8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 3675 microversion: 2.20 time: 0.143679 Jan 17 02:42:21.243423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 554/1073] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:21 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 3675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:42:21.480509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:21.481125 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:21.489686 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:21.490137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:21.490911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:21.491339 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:21.513207 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lazy-loading 'flavor' on Instance uuid 836aee89-f8f7-4788-8051-2d62fd7adacb {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:42:21.588600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-db0a9f1b-24fb-4e39-b665-a6b9c2e90697 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "POST /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb/action" status: 202 len: 0 microversion: 2.1 time: 0.228928 Jan 17 02:42:21.589404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 520/1074] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:42:21 2022] POST /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:21.597997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:21.598675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:21.605443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:21.605894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:21.606724 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:21.607163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:21.743235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:21.754839 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-81324e94-d772-4c96-bf52-51460063cad1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.160565 Jan 17 02:42:21.755580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 555/1075] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:21 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:22.256822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ef99f5a5-f476-481a-ad70-831454837f74 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:22.257889 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ef99f5a5-f476-481a-ad70-831454837f74 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:22.264927 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef99f5a5-f476-481a-ad70-831454837f74 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:22.265380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef99f5a5-f476-481a-ad70-831454837f74 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:22.266162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef99f5a5-f476-481a-ad70-831454837f74 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:22.266596 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef99f5a5-f476-481a-ad70-831454837f74 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:22.363576 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ef99f5a5-f476-481a-ad70-831454837f74 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 15025 microversion: 2.20 time: 0.110501 Jan 17 02:42:22.364644 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 521/1076] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:22 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 15025 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:22.776888 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:22.777893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:22.786882 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:22.787334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:22.788133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:22.788595 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:22.925394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:22.933431 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7fe462e6-c418-4077-a7f1-454bf01c6d98 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.163223 Jan 17 02:42:22.934046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 556/1077] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:22 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:23.377246 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7df5c413-12a6-443d-988a-b87b1e1894d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:23.378237 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7df5c413-12a6-443d-988a-b87b1e1894d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:23.385475 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7df5c413-12a6-443d-988a-b87b1e1894d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:23.385916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7df5c413-12a6-443d-988a-b87b1e1894d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:23.386692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7df5c413-12a6-443d-988a-b87b1e1894d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:23.387119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7df5c413-12a6-443d-988a-b87b1e1894d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:23.504602 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7df5c413-12a6-443d-988a-b87b1e1894d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 18561 microversion: 2.20 time: 0.130765 Jan 17 02:42:23.505483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 522/1078] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:23 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 18561 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:23.954714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:23.955739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:23.962541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:23.963007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:23.963787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:23.964274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:24.100315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:24.108262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d4f45ec6-97cf-45d7-b58e-8cc3553fe8ad tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.159719 Jan 17 02:42:24.108867 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 557/1079] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:23 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:24.522870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c59289f7-3fc6-4e55-9000-d75f46df1dcf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:24.528502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c59289f7-3fc6-4e55-9000-d75f46df1dcf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:24.531436 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c59289f7-3fc6-4e55-9000-d75f46df1dcf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:24.531879 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c59289f7-3fc6-4e55-9000-d75f46df1dcf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:24.533708 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c59289f7-3fc6-4e55-9000-d75f46df1dcf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:24.534382 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c59289f7-3fc6-4e55-9000-d75f46df1dcf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:24.644136 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c59289f7-3fc6-4e55-9000-d75f46df1dcf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 19342 microversion: 2.20 time: 0.127415 Jan 17 02:42:24.645189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 523/1080] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:24 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 19342 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:25.128640 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:25.129189 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:25.135951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:25.136436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:25.137216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:25.137657 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:25.282243 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:25.290290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f6eba370-a708-4bca-a65d-9685cc0a7629 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.167259 Jan 17 02:42:25.290855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 558/1081] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:25 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:25.661740 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8357c94b-b22a-4022-8eb7-f652f5c8a85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:25.662841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8357c94b-b22a-4022-8eb7-f652f5c8a85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:25.670724 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8357c94b-b22a-4022-8eb7-f652f5c8a85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:25.671219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8357c94b-b22a-4022-8eb7-f652f5c8a85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:25.672095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8357c94b-b22a-4022-8eb7-f652f5c8a85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:25.672585 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8357c94b-b22a-4022-8eb7-f652f5c8a85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:25.778042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8357c94b-b22a-4022-8eb7-f652f5c8a85a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 22162 microversion: 2.20 time: 0.121250 Jan 17 02:42:25.779034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 524/1082] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:25 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 22162 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:26.311346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:26.312711 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:26.323099 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:26.323846 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:26.325176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:26.325886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:26.463365 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:26.471706 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-de3ef5cd-1c9b-4fb4-bafd-27539f6fac8e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.166528 Jan 17 02:42:26.472331 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 559/1083] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:26 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:26.797286 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-155b5427-7b3e-41a7-900d-500fca7be28f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:26.798910 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-155b5427-7b3e-41a7-900d-500fca7be28f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:26.806258 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-155b5427-7b3e-41a7-900d-500fca7be28f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:26.806707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-155b5427-7b3e-41a7-900d-500fca7be28f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:26.807490 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-155b5427-7b3e-41a7-900d-500fca7be28f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:26.807917 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-155b5427-7b3e-41a7-900d-500fca7be28f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:26.923354 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-155b5427-7b3e-41a7-900d-500fca7be28f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 23798 microversion: 2.20 time: 0.132832 Jan 17 02:42:26.924676 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 525/1084] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:26 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 23798 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:27.492791 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:27.493750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:27.504270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:27.504651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:27.505475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:27.505884 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:27.638943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:27.646510 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-bcdf2686-c470-413e-a47e-6b114487088e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.160030 Jan 17 02:42:27.647081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 560/1085] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:27 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:27.940700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-98acc4b0-452d-4fd3-a5ea-264cc3029cde tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:27.941733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-98acc4b0-452d-4fd3-a5ea-264cc3029cde tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:27.949111 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-98acc4b0-452d-4fd3-a5ea-264cc3029cde tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:27.949566 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-98acc4b0-452d-4fd3-a5ea-264cc3029cde tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:27.950342 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-98acc4b0-452d-4fd3-a5ea-264cc3029cde tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:27.950774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-98acc4b0-452d-4fd3-a5ea-264cc3029cde tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:28.055150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-98acc4b0-452d-4fd3-a5ea-264cc3029cde tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 25086 microversion: 2.20 time: 0.120868 Jan 17 02:42:28.056268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 526/1086] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:27 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 25086 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:28.666542 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:28.667183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:28.675647 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:28.676100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:28.676904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:28.677332 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:28.835915 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:28.845438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-36ffa655-d9b4-4896-94bd-fe4015aa95f0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.185021 Jan 17 02:42:28.846022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 561/1087] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:28 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:29.070094 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2dcd1fb0-10e8-40d5-911c-6d1129683244 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:29.070971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2dcd1fb0-10e8-40d5-911c-6d1129683244 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:29.081026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2dcd1fb0-10e8-40d5-911c-6d1129683244 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:29.081530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2dcd1fb0-10e8-40d5-911c-6d1129683244 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:29.082315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2dcd1fb0-10e8-40d5-911c-6d1129683244 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:29.082745 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2dcd1fb0-10e8-40d5-911c-6d1129683244 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:29.188380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2dcd1fb0-10e8-40d5-911c-6d1129683244 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 26488 microversion: 2.20 time: 0.121997 Jan 17 02:42:29.189285 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 527/1088] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:29 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 26488 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:29.863070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:29.863849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:29.870792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:29.871280 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:29.872102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:29.872588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:30.004639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:30.012607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-705779e7-02f8-485d-bd01-7f5dc3a09511 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.153458 Jan 17 02:42:30.013174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 562/1089] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:29 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:30.206527 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f3268948-44de-4428-a1df-b8298c0fc1c4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:30.207998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f3268948-44de-4428-a1df-b8298c0fc1c4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:30.219328 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f3268948-44de-4428-a1df-b8298c0fc1c4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:30.220118 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f3268948-44de-4428-a1df-b8298c0fc1c4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:30.221399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f3268948-44de-4428-a1df-b8298c0fc1c4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:30.222057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f3268948-44de-4428-a1df-b8298c0fc1c4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:30.329712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f3268948-44de-4428-a1df-b8298c0fc1c4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 27506 microversion: 2.20 time: 0.129449 Jan 17 02:42:30.330719 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 528/1090] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:30 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 27506 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:31.035873 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:31.036903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:31.047573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:31.048385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:31.049663 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:31.050404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:31.196467 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:31.207586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c1b8030b-4175-437a-9196-fe6a0d0a5abd tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.177902 Jan 17 02:42:31.208429 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 563/1091] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:31 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:31.347845 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2775e9eb-8161-4eba-b478-28abcd1aecfe tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:31.349328 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2775e9eb-8161-4eba-b478-28abcd1aecfe tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:31.359977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2775e9eb-8161-4eba-b478-28abcd1aecfe tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:31.360718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2775e9eb-8161-4eba-b478-28abcd1aecfe tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:31.361997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2775e9eb-8161-4eba-b478-28abcd1aecfe tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:31.362623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2775e9eb-8161-4eba-b478-28abcd1aecfe tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:31.461339 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2775e9eb-8161-4eba-b478-28abcd1aecfe tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 27880 microversion: 2.20 time: 0.119665 Jan 17 02:42:31.462334 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 529/1092] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:31 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 27880 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:32.230164 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:32.230784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:32.237635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:32.238087 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:32.238871 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:32.239307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:32.368109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:32.375592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8734a34a-e95e-4d34-b77d-351623ae0c88 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.149173 Jan 17 02:42:32.376373 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 564/1093] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:32 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:32.480269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c3f73f94-cfc5-4a2a-9f1e-0a0995ade373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:32.481800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c3f73f94-cfc5-4a2a-9f1e-0a0995ade373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:32.493174 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3f73f94-cfc5-4a2a-9f1e-0a0995ade373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:32.493929 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3f73f94-cfc5-4a2a-9f1e-0a0995ade373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:32.495249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3f73f94-cfc5-4a2a-9f1e-0a0995ade373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:32.496026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c3f73f94-cfc5-4a2a-9f1e-0a0995ade373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:32.599546 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c3f73f94-cfc5-4a2a-9f1e-0a0995ade373 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.125815 Jan 17 02:42:32.600922 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 530/1094] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:32 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:33.393258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:33.393822 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:33.400797 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:33.401580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:33.402368 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:33.402805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:33.541470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:33.549789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-899a8ccd-50a1-4e79-8d28-38a5229d7438 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.160270 Jan 17 02:42:33.550378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 565/1095] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:33 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:33.612614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5527d1bb-2ca5-4fe0-86aa-039869396ca4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:33.613611 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5527d1bb-2ca5-4fe0-86aa-039869396ca4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:33.620776 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5527d1bb-2ca5-4fe0-86aa-039869396ca4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:33.621225 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5527d1bb-2ca5-4fe0-86aa-039869396ca4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:33.621995 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5527d1bb-2ca5-4fe0-86aa-039869396ca4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:33.622425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5527d1bb-2ca5-4fe0-86aa-039869396ca4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:33.775390 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5527d1bb-2ca5-4fe0-86aa-039869396ca4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.166278 Jan 17 02:42:33.776811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 531/1096] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:33 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:34.567728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:34.568405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:34.576217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.576663 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.577427 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.577853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.717482 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:34.725130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e71f826a-19a3-463f-8dd3-3ee8583a3ae8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1567 microversion: 2.1 time: 0.162057 Jan 17 02:42:34.725695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 566/1097] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:34 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:34.751053 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5f92bb81-7f0d-48d4-af93-921a7064dba9 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:34.751752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5f92bb81-7f0d-48d4-af93-921a7064dba9 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:34.762787 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5f92bb81-7f0d-48d4-af93-921a7064dba9 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.763228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5f92bb81-7f0d-48d4-af93-921a7064dba9 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.764006 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5f92bb81-7f0d-48d4-af93-921a7064dba9 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.764473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5f92bb81-7f0d-48d4-af93-921a7064dba9 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.790090 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6f2b98b3-cb0b-4a96-890d-660023238c58 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:34.791135 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6f2b98b3-cb0b-4a96-890d-660023238c58 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:34.799261 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f2b98b3-cb0b-4a96-890d-660023238c58 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.799904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f2b98b3-cb0b-4a96-890d-660023238c58 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.800947 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f2b98b3-cb0b-4a96-890d-660023238c58 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.801385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f2b98b3-cb0b-4a96-890d-660023238c58 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.858896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5f92bb81-7f0d-48d4-af93-921a7064dba9 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "POST /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb/action" status: 202 len: 0 microversion: 2.1 time: 0.114504 Jan 17 02:42:34.859820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 532/1098] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:42:34 2022] POST /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:34.867447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:34.868262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:34.874468 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.874926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.875714 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:34.876182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:34.902670 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6f2b98b3-cb0b-4a96-890d-660023238c58 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.115387 Jan 17 02:42:34.903540 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 567/1099] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:34 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:35.018250 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:35.026645 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f03fdf46-2ad8-4887-9d97-ab417240a3d0 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1575 microversion: 2.1 time: 0.162289 Jan 17 02:42:35.027193 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 533/1100] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:34 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:42:35.914825 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fb8f8bcb-0574-4100-bc7e-f919448a2bd3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:35.915826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fb8f8bcb-0574-4100-bc7e-f919448a2bd3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:35.922931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fb8f8bcb-0574-4100-bc7e-f919448a2bd3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:35.923399 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fb8f8bcb-0574-4100-bc7e-f919448a2bd3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:35.924185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fb8f8bcb-0574-4100-bc7e-f919448a2bd3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:35.924616 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fb8f8bcb-0574-4100-bc7e-f919448a2bd3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:36.028631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fb8f8bcb-0574-4100-bc7e-f919448a2bd3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.117773 Jan 17 02:42:36.031469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 568/1101] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:35 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:36.044023 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:36.044646 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:36.051371 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:36.051833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:36.052669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:36.053112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:36.190879 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:36.198697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-330969dd-5ef9-4036-9b0c-06dcddc5294b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1517 microversion: 2.1 time: 0.158367 Jan 17 02:42:36.199267 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 534/1102] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:36 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:36.611180 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-27ee1fc5-fba2-48fc-b5b3-18dd4df4e9a3 req-e7c2e86a-f16a-4036-ac86-6d0a7b8a2ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836aee89-f8f7-4788-8051-2d62fd7adacb", "name": "network-vif-unplugged", "status": "completed", "tag": "c601475c-0c44-4ca7-a396-6569cecefedc"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:36.612902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:36.612902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:42:36.621104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-27ee1fc5-fba2-48fc-b5b3-18dd4df4e9a3 req-e7c2e86a-f16a-4036-ac86-6d0a7b8a2ef9 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:36.621573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-27ee1fc5-fba2-48fc-b5b3-18dd4df4e9a3 req-e7c2e86a-f16a-4036-ac86-6d0a7b8a2ef9 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:36.633242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-27ee1fc5-fba2-48fc-b5b3-18dd4df4e9a3 req-e7c2e86a-f16a-4036-ac86-6d0a7b8a2ef9 service nova] Creating event network-vif-unplugged:c601475c-0c44-4ca7-a396-6569cecefedc for instance 836aee89-f8f7-4788-8051-2d62fd7adacb on hv-cinder-82160 Jan 17 02:42:36.645968 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-27ee1fc5-fba2-48fc-b5b3-18dd4df4e9a3 req-e7c2e86a-f16a-4036-ac86-6d0a7b8a2ef9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038699 Jan 17 02:42:36.646607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 569/1103] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:37.042378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b508b1cc-2344-4d5e-abdf-7f31b1cdea4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:37.043825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b508b1cc-2344-4d5e-abdf-7f31b1cdea4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:37.051643 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b508b1cc-2344-4d5e-abdf-7f31b1cdea4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:37.052299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b508b1cc-2344-4d5e-abdf-7f31b1cdea4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:37.052891 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b508b1cc-2344-4d5e-abdf-7f31b1cdea4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:37.053327 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b508b1cc-2344-4d5e-abdf-7f31b1cdea4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:37.151389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b508b1cc-2344-4d5e-abdf-7f31b1cdea4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.113515 Jan 17 02:42:37.152080 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 535/1104] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:37 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:37.221782 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:37.222659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:37.233638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:37.234085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:37.234878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:37.235311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:37.380030 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:37.388612 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a14a39d7-a387-4c9b-90dd-f3384d8bb1a8 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.175730 Jan 17 02:42:37.389222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 570/1105] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:37 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:38.167534 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c0a4fe10-9496-4528-9521-b16b72df4b69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:38.169189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c0a4fe10-9496-4528-9521-b16b72df4b69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:38.179150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0a4fe10-9496-4528-9521-b16b72df4b69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.179601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0a4fe10-9496-4528-9521-b16b72df4b69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.180421 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0a4fe10-9496-4528-9521-b16b72df4b69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.180857 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c0a4fe10-9496-4528-9521-b16b72df4b69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.212748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c9a2534e-9efd-42cb-8ca7-19606517f64a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:38.213659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c9a2534e-9efd-42cb-8ca7-19606517f64a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:38.220624 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9a2534e-9efd-42cb-8ca7-19606517f64a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.221075 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9a2534e-9efd-42cb-8ca7-19606517f64a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.221870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9a2534e-9efd-42cb-8ca7-19606517f64a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.222444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c9a2534e-9efd-42cb-8ca7-19606517f64a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.251986 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c9a2534e-9efd-42cb-8ca7-19606517f64a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044286 Jan 17 02:42:38.252551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 571/1106] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:42:38 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:42:38.271923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c0a4fe10-9496-4528-9521-b16b72df4b69 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.110947 Jan 17 02:42:38.272601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 536/1107] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:38 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:38.307736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:38.308270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:38.314695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.315147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.315927 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.316408 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.340904 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:42:38.406465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:38.407120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:38.414041 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.414537 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.415303 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.415979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.424330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4c56dfe5-1411-4c11-8aa3-710e3734fa55 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 204 len: 0 microversion: 2.1 time: 0.119944 Jan 17 02:42:38.424982 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 572/1108] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:42:38 2022] DELETE /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:42:38.433822 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:38.434508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:38.440614 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.441065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.441860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:38.442362 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:38.630674 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:38.634949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:38.638607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2188e011-ab54-4fcf-b930-d5a45c1731d4 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.236222 Jan 17 02:42:38.639144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 537/1109] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:38 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:42:38.642571 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0680272d-6cfd-4486-a2d9-8c380f7cd9c1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1673 microversion: 2.1 time: 0.212744 Jan 17 02:42:38.643123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 573/1110] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:38 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1673 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:39.284784 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-768ac276-7f33-486e-9b82-0cc6686f8d3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:39.286010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-768ac276-7f33-486e-9b82-0cc6686f8d3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:39.292740 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-768ac276-7f33-486e-9b82-0cc6686f8d3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:39.293191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-768ac276-7f33-486e-9b82-0cc6686f8d3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:39.293972 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-768ac276-7f33-486e-9b82-0cc6686f8d3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:39.294403 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-768ac276-7f33-486e-9b82-0cc6686f8d3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:39.473716 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-768ac276-7f33-486e-9b82-0cc6686f8d3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.192940 Jan 17 02:42:39.474812 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 538/1111] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:39 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:39.659806 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:39.661044 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:39.667543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:39.669199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:39.672390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:39.673162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:39.674539 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:39.675283 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:39.680569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:39.681312 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:39.682121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:39.682530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:39.872435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:39.875757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:39.881121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-24e4b3ea-850c-4cc5-b0b8-d7935f7ab971 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.227447 Jan 17 02:42:39.882215 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 574/1112] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:39 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:39.883671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bb42c6ad-cb12-444e-9843-cf3e8c3d994a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1673 microversion: 2.1 time: 0.222775 Jan 17 02:42:39.890279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 539/1113] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:39 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:40.488094 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3349c8f9-e7a9-4ead-ab91-df8f4c70c278 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:40.489121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3349c8f9-e7a9-4ead-ab91-df8f4c70c278 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:40.494915 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3349c8f9-e7a9-4ead-ab91-df8f4c70c278 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:40.495390 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3349c8f9-e7a9-4ead-ab91-df8f4c70c278 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:40.496191 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3349c8f9-e7a9-4ead-ab91-df8f4c70c278 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:40.496619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3349c8f9-e7a9-4ead-ab91-df8f4c70c278 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:40.588598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3349c8f9-e7a9-4ead-ab91-df8f4c70c278 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.103981 Jan 17 02:42:40.589267 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 575/1114] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:40 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:40.898540 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:40.900002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:40.900638 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:40.901796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:40.909173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:40.909760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:40.910504 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:40.910702 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:40.911053 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:40.911189 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:40.911990 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:40.912654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:41.015723 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:41.023520 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-09254288-e849-417f-893d-9ee998242784 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 200 len: 1605 microversion: 2.1 time: 0.127210 Jan 17 02:42:41.024074 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 576/1115] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:40 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 1605 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:41.168739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:41.176918 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a71e7e90-b871-4c2c-b624-2edd436e93c2 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.282510 Jan 17 02:42:41.177495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 540/1116] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:40 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:41.255064 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-98a21e47-81a9-418a-839b-f11106005541 req-ab22bf33-01d3-4a22-bbf8-59af841bb852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d7c373-a92e-48a3-8605-f8655cf5cba4", "name": "network-vif-deleted", "tag": "33b46f70-f49c-41cd-8f07-0740b1f82d6b"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:41.256699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:41.256699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:42:41.267729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-98a21e47-81a9-418a-839b-f11106005541 req-ab22bf33-01d3-4a22-bbf8-59af841bb852 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:41.267729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-98a21e47-81a9-418a-839b-f11106005541 req-ab22bf33-01d3-4a22-bbf8-59af841bb852 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:41.278247 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-98a21e47-81a9-418a-839b-f11106005541 req-ab22bf33-01d3-4a22-bbf8-59af841bb852 service nova] Creating event network-vif-deleted:33b46f70-f49c-41cd-8f07-0740b1f82d6b for instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 on hv-cinder-82160 Jan 17 02:42:41.283503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-98a21e47-81a9-418a-839b-f11106005541 req-ab22bf33-01d3-4a22-bbf8-59af841bb852 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Jan 17 02:42:41.287252 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 577/1117] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:41.600600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-63e5b410-350a-4689-ade8-d382e2225293 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:41.601582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-63e5b410-350a-4689-ade8-d382e2225293 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:41.607823 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63e5b410-350a-4689-ade8-d382e2225293 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:41.608325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63e5b410-350a-4689-ade8-d382e2225293 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:41.609111 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63e5b410-350a-4689-ade8-d382e2225293 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:41.609653 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-63e5b410-350a-4689-ade8-d382e2225293 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:41.720715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-63e5b410-350a-4689-ade8-d382e2225293 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.123693 Jan 17 02:42:41.721617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 541/1118] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:41 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:42.042696 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:42.043359 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:42.050751 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:42.051489 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:42.052386 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:42.052827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:42.067002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] HTTP exception thrown: Instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 could not be found. Jan 17 02:42:42.067597 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Returning 404 to user: Instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:42:42.068468 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7d755221-86b6-4ede-94ae-8fc0b24f5178 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 404 len: 111 microversion: 2.1 time: 0.030380 Jan 17 02:42:42.069065 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 578/1119] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:42 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:42:42.078586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-848f84c4-842e-4bfb-8154-51d890fc9faa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '.version_select at 0x7f074dd8fee0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:42.100201 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-848f84c4-842e-4bfb-8154-51d890fc9faa tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113612085" status: 202 len: 0 microversion: 2.1 time: 0.025630 Jan 17 02:42:42.100786 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 542/1120] 10.222.0.24 () {58 vars in 1217 bytes} [Mon Jan 17 02:42:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113612085 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:42.193477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:42.194074 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:42.200243 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:42.201154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:42.201482 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:42.201898 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:42.450779 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:42.459347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d0d9561e-1c6c-4583-abac-d465df6dfe6b tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.269619 Jan 17 02:42:42.459937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 579/1121] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:42 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:42.733732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6ceefa36-a42c-4436-bef6-6ee191cc6221 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:42.734749 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6ceefa36-a42c-4436-bef6-6ee191cc6221 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:42.744056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ceefa36-a42c-4436-bef6-6ee191cc6221 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:42.744657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ceefa36-a42c-4436-bef6-6ee191cc6221 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:42.745460 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ceefa36-a42c-4436-bef6-6ee191cc6221 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:42.745947 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6ceefa36-a42c-4436-bef6-6ee191cc6221 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:42.828598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6ceefa36-a42c-4436-bef6-6ee191cc6221 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.099080 Jan 17 02:42:42.829371 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 543/1122] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:42 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:42.877440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-647d7dd5-224f-47ea-b047-719f03f99479 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'create', calling method: .version_select at 0x7f074dd185e0>, body: {"keypair": {"name": "tempest-keypair-1659246922"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:42.892657 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-647d7dd5-224f-47ea-b047-719f03f99479 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:42:42.897521 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-647d7dd5-224f-47ea-b047-719f03f99479 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for user 8cb2f3ca95104ea3a8c5ca882908a454 and project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:42:43.112402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-647d7dd5-224f-47ea-b047-719f03f99479 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:42:43.116047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-647d7dd5-224f-47ea-b047-719f03f99479 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for user 8cb2f3ca95104ea3a8c5ca882908a454 and project cf0621b37a7046b4be225145a729936f. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:42:43.129184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-647d7dd5-224f-47ea-b047-719f03f99479 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.255503 Jan 17 02:42:43.129826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 580/1123] 10.222.0.24 () {60 vars in 1157 bytes} [Mon Jan 17 02:42:42 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:43.476908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:43.477602 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:43.484797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:43.485243 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:43.486023 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:43.486458 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:43.646148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:43.653855 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bfabc517-d255-4111-aef7-61bb32a798d6 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.181099 Jan 17 02:42:43.654432 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 544/1124] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:43 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:43.843090 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ae830923-da6b-4344-9a5d-b3c01ef9fe19 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:43.844005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ae830923-da6b-4344-9a5d-b3c01ef9fe19 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:43.850477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ae830923-da6b-4344-9a5d-b3c01ef9fe19 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:43.850931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ae830923-da6b-4344-9a5d-b3c01ef9fe19 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:43.851695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ae830923-da6b-4344-9a5d-b3c01ef9fe19 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:43.852157 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ae830923-da6b-4344-9a5d-b3c01ef9fe19 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:43.946461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ae830923-da6b-4344-9a5d-b3c01ef9fe19 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.107015 Jan 17 02:42:43.947758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 581/1125] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:43 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:44.453081 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1098827058", "imageRef": "6c464444-0a39-4d47-912d-4fe9bfbd777e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f4113a4-05d7-438d-9847-b83e4f657878"}], "security_groups": [{"name": "tempest-securitygroup--1203489389"}], "key_name": "tempest-keypair-1659246922", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:44.560483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] validate_networks() for [('0f4113a4-05d7-438d-9847-b83e4f657878', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:42:44.671229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:44.672037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:44.679220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:44.679665 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:44.680470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:44.680919 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:44.881956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:44.889750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-eaef8648-07ed-4181-8391-62c3ef1c79c1 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.222534 Jan 17 02:42:44.890292 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 582/1126] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:44 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:44.958821 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-942c3df5-f854-43de-a360-87e4b3f7318f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:44.959797 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-942c3df5-f854-43de-a360-87e4b3f7318f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:44.966381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-942c3df5-f854-43de-a360-87e4b3f7318f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:44.966833 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-942c3df5-f854-43de-a360-87e4b3f7318f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:44.967607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-942c3df5-f854-43de-a360-87e4b3f7318f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:44.968038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-942c3df5-f854-43de-a360-87e4b3f7318f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:44.986979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:42:44.987400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:42:44.987864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:42:44.988297 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:42:44.989335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:42:44.997623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:44.998046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:44.998884 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:44.999293 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:45.015002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for project cf0621b37a7046b4be225145a729936f. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:42:45.018937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Getting quotas for user 8cb2f3ca95104ea3a8c5ca882908a454 and project cf0621b37a7046b4be225145a729936f. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:42:45.029561 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:42:45.031897 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c464444-0a39-4d47-912d-4fe9bfbd777e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:42:45.053212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-942c3df5-f854-43de-a360-87e4b3f7318f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28177 microversion: 2.20 time: 0.098017 Jan 17 02:42:45.053851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 583/1127] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:44 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28177 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:45.077813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-642c578e-b7ea-4c07-9703-ff808850c65c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.628797 Jan 17 02:42:45.078447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 545/1128] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:42:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:42:45.088902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3dcefb9a-2beb-443c-ab52-f6317a684a9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:45.089569 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3dcefb9a-2beb-443c-ab52-f6317a684a9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:45.142944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3dcefb9a-2beb-443c-ab52-f6317a684a9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:45.149596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3dcefb9a-2beb-443c-ab52-f6317a684a9e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1238 microversion: 2.1 time: 0.064757 Jan 17 02:42:45.150147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 584/1129] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:45 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:42:45.907836 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:45.908415 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:45.915031 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:45.915479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:45.916300 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:45.916732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:46.054380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:46.062251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7445e895-3aed-410a-a843-57aabb94fb22 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.158738 Jan 17 02:42:46.062835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 546/1130] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:45 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:46.065773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d98646b8-f917-4af7-bbdd-50f0a61093f3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:46.067305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d98646b8-f917-4af7-bbdd-50f0a61093f3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:46.079014 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d98646b8-f917-4af7-bbdd-50f0a61093f3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:46.080199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d98646b8-f917-4af7-bbdd-50f0a61093f3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:46.081058 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d98646b8-f917-4af7-bbdd-50f0a61093f3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:46.081500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d98646b8-f917-4af7-bbdd-50f0a61093f3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:46.167112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:46.168242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:46.174488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:46.174920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:46.175694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:46.176171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:46.181575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d98646b8-f917-4af7-bbdd-50f0a61093f3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28302 microversion: 2.20 time: 0.120126 Jan 17 02:42:46.182486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 585/1131] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:46 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28302 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:46.252831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:46.261613 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-54ea7692-ab63-45da-b41f-71ac55f0894c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1308 microversion: 2.1 time: 0.098363 Jan 17 02:42:46.262180 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 547/1132] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:46 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:42:47.079303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:47.080348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:47.087661 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:47.088166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:47.088954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:47.089385 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:47.193101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-15b49358-4e89-4d6f-a0b3-1497241a85ad tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:47.194209 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-15b49358-4e89-4d6f-a0b3-1497241a85ad tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:47.200853 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-15b49358-4e89-4d6f-a0b3-1497241a85ad tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:47.201543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-15b49358-4e89-4d6f-a0b3-1497241a85ad tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:47.202978 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-15b49358-4e89-4d6f-a0b3-1497241a85ad tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:47.203431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-15b49358-4e89-4d6f-a0b3-1497241a85ad tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:47.299806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-15b49358-4e89-4d6f-a0b3-1497241a85ad tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28468 microversion: 2.20 time: 0.110182 Jan 17 02:42:47.304043 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 548/1133] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:47 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28468 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:42:47.309807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:47.310745 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:47.319644 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:47.320144 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:47.321318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:47.321929 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:47.349147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:47.363955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-00bb9274-e523-4682-81d1-47f4d7b8a318 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.288569 Jan 17 02:42:47.365707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 586/1134] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:47 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:47.556775 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:47.564875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-af9ddf97-bb9a-439b-a458-4c92c56243b1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1364 microversion: 2.1 time: 0.259113 Jan 17 02:42:47.565486 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 549/1135] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:47 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:47.642677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-cb15b56c-ec7b-4309-9afc-54fe85c79c74 req-4d543769-145f-40f1-9ea0-6fa15af434e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4836e82-be58-4d8d-91c3-f2bfb6aa86bd", "tag": "0502f2b8-44e9-4ef0-a037-909240354464"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:47.644338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:47.644338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:42:47.652891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-cb15b56c-ec7b-4309-9afc-54fe85c79c74 req-4d543769-145f-40f1-9ea0-6fa15af434e6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:47.653523 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-cb15b56c-ec7b-4309-9afc-54fe85c79c74 req-4d543769-145f-40f1-9ea0-6fa15af434e6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:47.669743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-cb15b56c-ec7b-4309-9afc-54fe85c79c74 req-4d543769-145f-40f1-9ea0-6fa15af434e6 service nova] Creating event network-changed:0502f2b8-44e9-4ef0-a037-909240354464 for instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd on hv-cinder-82160 Jan 17 02:42:47.674892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-cb15b56c-ec7b-4309-9afc-54fe85c79c74 req-4d543769-145f-40f1-9ea0-6fa15af434e6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035951 Jan 17 02:42:47.675919 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 587/1136] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:48.312440 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-91668ae7-e391-4a3a-8ce7-47234ad4f1b2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:48.313474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-91668ae7-e391-4a3a-8ce7-47234ad4f1b2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:48.319969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91668ae7-e391-4a3a-8ce7-47234ad4f1b2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:48.320458 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91668ae7-e391-4a3a-8ce7-47234ad4f1b2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:48.321283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91668ae7-e391-4a3a-8ce7-47234ad4f1b2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:48.321718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-91668ae7-e391-4a3a-8ce7-47234ad4f1b2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:48.383747 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:48.384749 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:48.392184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:48.392675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:48.393476 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:48.393911 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:48.488057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-91668ae7-e391-4a3a-8ce7-47234ad4f1b2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.179438 Jan 17 02:42:48.492311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 550/1137] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:48 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:48.583345 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:48.584427 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:48.592965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:48.593561 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:48.594474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:48.595009 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:48.893992 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:48.902369 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-174d1d00-ad4c-4b30-87f0-48fbaa0a872e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.522614 Jan 17 02:42:48.903198 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 588/1138] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:48 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:48.907488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-3fd08ec3-640d-4d35-92cb-c28b87d1c9fe req-53f08501-7b7b-476a-af00-c03a7b18fddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836aee89-f8f7-4788-8051-2d62fd7adacb", "name": "network-vif-plugged", "status": "completed", "tag": "c601475c-0c44-4ca7-a396-6569cecefedc"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:48.909059 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:48.909059 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:42:48.916870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-3fd08ec3-640d-4d35-92cb-c28b87d1c9fe req-53f08501-7b7b-476a-af00-c03a7b18fddf service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:48.917327 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-3fd08ec3-640d-4d35-92cb-c28b87d1c9fe req-53f08501-7b7b-476a-af00-c03a7b18fddf service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:48.929052 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-3fd08ec3-640d-4d35-92cb-c28b87d1c9fe req-53f08501-7b7b-476a-af00-c03a7b18fddf service nova] Creating event network-vif-plugged:c601475c-0c44-4ca7-a396-6569cecefedc for instance 836aee89-f8f7-4788-8051-2d62fd7adacb on hv-cinder-82160 Jan 17 02:42:48.934185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-3fd08ec3-640d-4d35-92cb-c28b87d1c9fe req-53f08501-7b7b-476a-af00-c03a7b18fddf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030038 Jan 17 02:42:48.934748 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 589/1139] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:49.034149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:49.041969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7d693b4f-eb03-4f78-8a6e-2931ecfa9eb7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1364 microversion: 2.1 time: 0.462874 Jan 17 02:42:49.042850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 551/1140] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:48 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1364 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:42:49.505226 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-35969ba7-b19a-443d-b2a7-daaba2f3e69d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:49.506712 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-35969ba7-b19a-443d-b2a7-daaba2f3e69d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:49.517457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35969ba7-b19a-443d-b2a7-daaba2f3e69d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:49.518212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35969ba7-b19a-443d-b2a7-daaba2f3e69d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:49.519496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35969ba7-b19a-443d-b2a7-daaba2f3e69d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:49.520371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35969ba7-b19a-443d-b2a7-daaba2f3e69d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:49.718241 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-35969ba7-b19a-443d-b2a7-daaba2f3e69d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.220565 Jan 17 02:42:49.718901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 590/1141] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:49 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:49.922795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:49.924842 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:49.935564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:49.936380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:49.937649 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:49.938392 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:50.059270 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:50.059944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:50.067259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:50.067720 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:50.068600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:50.069041 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:50.078657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:50.086159 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bfc31cd8-d8c9-4428-a6d1-b0fc53a6162e tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1573 microversion: 2.1 time: 0.169433 Jan 17 02:42:50.086750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 552/1142] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:49 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:50.205456 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:50.213626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b4581642-3227-4e7d-8d1f-b172c1f230ee tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1364 microversion: 2.1 time: 0.158443 Jan 17 02:42:50.214183 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 591/1143] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:50 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:50.730241 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1d57caf2-50de-4f9a-9cb8-7df0a79cd13c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:50.731263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1d57caf2-50de-4f9a-9cb8-7df0a79cd13c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:50.738607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d57caf2-50de-4f9a-9cb8-7df0a79cd13c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:50.738607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d57caf2-50de-4f9a-9cb8-7df0a79cd13c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:50.739272 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d57caf2-50de-4f9a-9cb8-7df0a79cd13c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:50.739707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d57caf2-50de-4f9a-9cb8-7df0a79cd13c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:50.892667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1d57caf2-50de-4f9a-9cb8-7df0a79cd13c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.165924 Jan 17 02:42:50.893314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 553/1144] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:50 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:51.102814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:51.103489 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:51.110325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:51.110772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:51.111546 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:51.111973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:51.231005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:51.231690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:51.239182 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:51.239604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:51.240424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:51.241048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:51.249810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:51.259875 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1168de52-3f27-43c2-aa9f-d164db5b839d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1560 microversion: 2.1 time: 0.160765 Jan 17 02:42:51.260575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 592/1145] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:51 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:51.377988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:51.385977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-66cca4ed-8b2b-493b-855c-6e2f6a4f1192 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1364 microversion: 2.1 time: 0.158989 Jan 17 02:42:51.386553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 554/1146] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:51 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:51.909360 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7e727a27-f560-4c9e-94cb-ce8993c40fee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:51.910916 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7e727a27-f560-4c9e-94cb-ce8993c40fee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:51.917686 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e727a27-f560-4c9e-94cb-ce8993c40fee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:51.918132 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e727a27-f560-4c9e-94cb-ce8993c40fee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:51.918909 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e727a27-f560-4c9e-94cb-ce8993c40fee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:51.919344 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7e727a27-f560-4c9e-94cb-ce8993c40fee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:52.076420 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7e727a27-f560-4c9e-94cb-ce8993c40fee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.172657 Jan 17 02:42:52.077285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 593/1147] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:51 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:52.407054 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:52.408041 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:52.418606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:52.419352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:52.420695 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:52.421417 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:52.563850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:52.573072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7da72690-1996-4ac7-8a98-d46d4dfba8f8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1364 microversion: 2.1 time: 0.172640 Jan 17 02:42:52.573659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 555/1148] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:52 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:52.763459 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-d637846a-238d-4882-953a-6517d4c1e7ca req-ff6f66c3-1831-40a5-b919-38d859c0fb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4836e82-be58-4d8d-91c3-f2bfb6aa86bd", "name": "network-vif-plugged", "status": "completed", "tag": "0502f2b8-44e9-4ef0-a037-909240354464"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:52.764997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:52.764997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:42:52.773089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-d637846a-238d-4882-953a-6517d4c1e7ca req-ff6f66c3-1831-40a5-b919-38d859c0fb76 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:52.773533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-d637846a-238d-4882-953a-6517d4c1e7ca req-ff6f66c3-1831-40a5-b919-38d859c0fb76 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:52.785430 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-d637846a-238d-4882-953a-6517d4c1e7ca req-ff6f66c3-1831-40a5-b919-38d859c0fb76 service nova] Creating event network-vif-plugged:0502f2b8-44e9-4ef0-a037-909240354464 for instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd on hv-cinder-82160 Jan 17 02:42:52.794005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-d637846a-238d-4882-953a-6517d4c1e7ca req-ff6f66c3-1831-40a5-b919-38d859c0fb76 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034504 Jan 17 02:42:52.794800 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 594/1149] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:53.090551 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-13a6de6c-bb63-4828-abfd-40070c88781b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:53.091477 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-13a6de6c-bb63-4828-abfd-40070c88781b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:53.097970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13a6de6c-bb63-4828-abfd-40070c88781b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:53.098420 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13a6de6c-bb63-4828-abfd-40070c88781b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:53.099210 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13a6de6c-bb63-4828-abfd-40070c88781b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:53.099650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-13a6de6c-bb63-4828-abfd-40070c88781b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:53.575709 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-13a6de6c-bb63-4828-abfd-40070c88781b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.488284 Jan 17 02:42:53.576447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 556/1150] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:53 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:53.591482 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:53.592334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:53.599538 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:53.599973 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:53.601297 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:53.601730 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:53.742061 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:53.750193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a2c9e62f-31b9-4f21-90c0-723eb20a52d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1364 microversion: 2.1 time: 0.163559 Jan 17 02:42:53.750764 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 595/1151] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:53 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:54.591076 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e75a1b83-d2c7-4d24-ac46-357cea0015a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:54.592445 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e75a1b83-d2c7-4d24-ac46-357cea0015a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:54.602658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e75a1b83-d2c7-4d24-ac46-357cea0015a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:54.603334 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e75a1b83-d2c7-4d24-ac46-357cea0015a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:54.604533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e75a1b83-d2c7-4d24-ac46-357cea0015a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:54.605154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e75a1b83-d2c7-4d24-ac46-357cea0015a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:54.737976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e75a1b83-d2c7-4d24-ac46-357cea0015a4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.152953 Jan 17 02:42:54.738682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 557/1152] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:54 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:54.766793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:54.767366 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:54.774106 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:54.774553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:54.775321 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:54.776097 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:54.926340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:42:54.935737 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-744fc46a-3bcc-4994-a69e-e78b330dd20e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1550 microversion: 2.1 time: 0.172395 Jan 17 02:42:54.936579 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 596/1153] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:42:54 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:42:54.953073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8da316e0-7a4b-4e30-9c2c-f922ebe03746 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:42:54.953772 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8da316e0-7a4b-4e30-9c2c-f922ebe03746 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:54.961037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da316e0-7a4b-4e30-9c2c-f922ebe03746 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:54.961494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da316e0-7a4b-4e30-9c2c-f922ebe03746 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:54.962284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da316e0-7a4b-4e30-9c2c-f922ebe03746 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:54.962720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8da316e0-7a4b-4e30-9c2c-f922ebe03746 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:55.045853 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8da316e0-7a4b-4e30-9c2c-f922ebe03746 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096856 Jan 17 02:42:55.046440 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 558/1154] 10.222.0.24 () {58 vars in 1274 bytes} [Mon Jan 17 02:42:54 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:55.749918 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-35375b5f-ee11-499c-8b98-934b8577729d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:55.750810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-35375b5f-ee11-499c-8b98-934b8577729d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:55.757424 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35375b5f-ee11-499c-8b98-934b8577729d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:55.757870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35375b5f-ee11-499c-8b98-934b8577729d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:55.758639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35375b5f-ee11-499c-8b98-934b8577729d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:55.759027 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-35375b5f-ee11-499c-8b98-934b8577729d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:55.846102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-35375b5f-ee11-499c-8b98-934b8577729d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.099656 Jan 17 02:42:55.846739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 597/1155] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:55 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:56.003545 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6817541e-e58d-4147-a31a-e2a99b32c5d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:56.005457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6817541e-e58d-4147-a31a-e2a99b32c5d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:56.006225 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-290620b0-5763-421a-8a07-71ee5472029b req-d061191c-520a-4278-871d-48b64f66bf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4836e82-be58-4d8d-91c3-f2bfb6aa86bd", "tag": "0502f2b8-44e9-4ef0-a037-909240354464"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:56.007752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:42:56.007752 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:42:56.015196 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6817541e-e58d-4147-a31a-e2a99b32c5d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:56.015757 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6817541e-e58d-4147-a31a-e2a99b32c5d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:56.015894 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-290620b0-5763-421a-8a07-71ee5472029b req-d061191c-520a-4278-871d-48b64f66bf8d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:56.016355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-290620b0-5763-421a-8a07-71ee5472029b req-d061191c-520a-4278-871d-48b64f66bf8d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:56.016750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6817541e-e58d-4147-a31a-e2a99b32c5d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:56.017431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6817541e-e58d-4147-a31a-e2a99b32c5d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:56.028702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-290620b0-5763-421a-8a07-71ee5472029b req-d061191c-520a-4278-871d-48b64f66bf8d service nova] Creating event network-changed:0502f2b8-44e9-4ef0-a037-909240354464 for instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd on hv-cinder-82160 Jan 17 02:42:56.035263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-290620b0-5763-421a-8a07-71ee5472029b req-d061191c-520a-4278-871d-48b64f66bf8d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034412 Jan 17 02:42:56.036822 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 598/1156] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:42:56.136615 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6817541e-e58d-4147-a31a-e2a99b32c5d3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.139422 Jan 17 02:42:56.140003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 559/1157] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:42:55 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:42:56.859172 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7d9a505b-fb02-455d-9fb5-fc36033ddec3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:56.860207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7d9a505b-fb02-455d-9fb5-fc36033ddec3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:56.867222 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d9a505b-fb02-455d-9fb5-fc36033ddec3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:56.867673 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d9a505b-fb02-455d-9fb5-fc36033ddec3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:56.868525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d9a505b-fb02-455d-9fb5-fc36033ddec3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:56.868965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7d9a505b-fb02-455d-9fb5-fc36033ddec3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:56.966193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7d9a505b-fb02-455d-9fb5-fc36033ddec3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.111429 Jan 17 02:42:56.966729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 599/1158] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:56 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:57.147533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-55c4327e-f86b-4ae1-9043-621dadc4c0e7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:57.148624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-55c4327e-f86b-4ae1-9043-621dadc4c0e7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:57.156104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55c4327e-f86b-4ae1-9043-621dadc4c0e7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:57.156554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55c4327e-f86b-4ae1-9043-621dadc4c0e7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:57.157332 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55c4327e-f86b-4ae1-9043-621dadc4c0e7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:57.157760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-55c4327e-f86b-4ae1-9043-621dadc4c0e7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:57.268664 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-55c4327e-f86b-4ae1-9043-621dadc4c0e7 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.124936 Jan 17 02:42:57.269589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 560/1159] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:42:57 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:42:57.979144 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-176aabb9-16d1-4eb4-abcd-b09ca14c174c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:57.980058 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-176aabb9-16d1-4eb4-abcd-b09ca14c174c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:57.987329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-176aabb9-16d1-4eb4-abcd-b09ca14c174c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:57.987777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-176aabb9-16d1-4eb4-abcd-b09ca14c174c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:57.988635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-176aabb9-16d1-4eb4-abcd-b09ca14c174c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:57.989068 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-176aabb9-16d1-4eb4-abcd-b09ca14c174c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:58.081136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-176aabb9-16d1-4eb4-abcd-b09ca14c174c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.105646 Jan 17 02:42:58.082105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 600/1160] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:57 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:58.282015 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9e50292d-f977-41ad-b9d2-4c99b9b53031 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:58.283074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9e50292d-f977-41ad-b9d2-4c99b9b53031 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:58.290683 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9e50292d-f977-41ad-b9d2-4c99b9b53031 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:58.291166 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9e50292d-f977-41ad-b9d2-4c99b9b53031 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:58.292002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9e50292d-f977-41ad-b9d2-4c99b9b53031 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:58.292500 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9e50292d-f977-41ad-b9d2-4c99b9b53031 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:58.383342 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9e50292d-f977-41ad-b9d2-4c99b9b53031 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.105006 Jan 17 02:42:58.384362 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 561/1161] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:42:58 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:42:59.100349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-30c831b4-fa4c-4a45-981f-6547d311508f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:59.101948 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-30c831b4-fa4c-4a45-981f-6547d311508f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:59.113558 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30c831b4-fa4c-4a45-981f-6547d311508f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:59.114113 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30c831b4-fa4c-4a45-981f-6547d311508f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:59.114889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30c831b4-fa4c-4a45-981f-6547d311508f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:59.115319 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30c831b4-fa4c-4a45-981f-6547d311508f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:59.206935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-30c831b4-fa4c-4a45-981f-6547d311508f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.112866 Jan 17 02:42:59.208096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 601/1162] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:42:59 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:42:59.401413 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3f55a31c-9f1e-41f7-8821-eea5a3008deb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:42:59.403063 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3f55a31c-9f1e-41f7-8821-eea5a3008deb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:42:59.413229 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f55a31c-9f1e-41f7-8821-eea5a3008deb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:59.413681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f55a31c-9f1e-41f7-8821-eea5a3008deb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:59.414469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f55a31c-9f1e-41f7-8821-eea5a3008deb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:42:59.414908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f55a31c-9f1e-41f7-8821-eea5a3008deb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:42:59.502816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3f55a31c-9f1e-41f7-8821-eea5a3008deb tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.108031 Jan 17 02:42:59.503663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 562/1163] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:42:59 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:00.225565 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b33cebf7-5601-416f-a1b7-7b9f45ce49d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:00.226731 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b33cebf7-5601-416f-a1b7-7b9f45ce49d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:00.235136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b33cebf7-5601-416f-a1b7-7b9f45ce49d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:00.235662 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b33cebf7-5601-416f-a1b7-7b9f45ce49d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:00.236626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b33cebf7-5601-416f-a1b7-7b9f45ce49d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:00.237138 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b33cebf7-5601-416f-a1b7-7b9f45ce49d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:00.337303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b33cebf7-5601-416f-a1b7-7b9f45ce49d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.117465 Jan 17 02:43:00.338248 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 602/1164] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:00 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:00.520488 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a724a2c2-7296-489b-8d98-aafe02f7acab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:00.521861 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a724a2c2-7296-489b-8d98-aafe02f7acab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:00.529713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a724a2c2-7296-489b-8d98-aafe02f7acab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:00.530198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a724a2c2-7296-489b-8d98-aafe02f7acab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:00.531032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a724a2c2-7296-489b-8d98-aafe02f7acab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:00.531526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a724a2c2-7296-489b-8d98-aafe02f7acab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:00.618778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a724a2c2-7296-489b-8d98-aafe02f7acab tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.104865 Jan 17 02:43:00.619739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 563/1165] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:00 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:01.355823 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f213fdf7-e0d7-47b9-bab2-011d066e18fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:01.357494 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f213fdf7-e0d7-47b9-bab2-011d066e18fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:01.367532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f213fdf7-e0d7-47b9-bab2-011d066e18fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:01.368012 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f213fdf7-e0d7-47b9-bab2-011d066e18fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:01.368806 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f213fdf7-e0d7-47b9-bab2-011d066e18fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:01.369227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f213fdf7-e0d7-47b9-bab2-011d066e18fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:01.466863 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f213fdf7-e0d7-47b9-bab2-011d066e18fd tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.117326 Jan 17 02:43:01.467846 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 603/1166] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:01 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:01.636610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2e2afd70-1ef0-47ba-b046-858c3589f693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:01.638223 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2e2afd70-1ef0-47ba-b046-858c3589f693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:01.649691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e2afd70-1ef0-47ba-b046-858c3589f693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:01.650434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e2afd70-1ef0-47ba-b046-858c3589f693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:01.652121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e2afd70-1ef0-47ba-b046-858c3589f693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:01.652880 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2e2afd70-1ef0-47ba-b046-858c3589f693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:01.754948 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2e2afd70-1ef0-47ba-b046-858c3589f693 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.125066 Jan 17 02:43:01.755565 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 564/1167] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:01 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:02.486043 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dbef9ed1-932f-4a24-8b61-ffc8e6913666 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:02.487656 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-dbef9ed1-932f-4a24-8b61-ffc8e6913666 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:02.499105 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbef9ed1-932f-4a24-8b61-ffc8e6913666 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:02.499856 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbef9ed1-932f-4a24-8b61-ffc8e6913666 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:02.501203 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbef9ed1-932f-4a24-8b61-ffc8e6913666 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:02.501928 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbef9ed1-932f-4a24-8b61-ffc8e6913666 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:02.603964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dbef9ed1-932f-4a24-8b61-ffc8e6913666 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.124305 Jan 17 02:43:02.604954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 604/1168] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:02 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:02.771642 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9a446528-ec60-4831-973b-5f904a69a0d8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:02.773087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9a446528-ec60-4831-973b-5f904a69a0d8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:02.782223 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a446528-ec60-4831-973b-5f904a69a0d8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:02.782800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a446528-ec60-4831-973b-5f904a69a0d8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:02.783779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a446528-ec60-4831-973b-5f904a69a0d8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:02.784384 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9a446528-ec60-4831-973b-5f904a69a0d8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:02.877100 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9a446528-ec60-4831-973b-5f904a69a0d8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.112307 Jan 17 02:43:02.877873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 565/1169] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:02 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:03.620415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-56018dc2-1b97-4484-8942-fc91e058e26d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:03.621417 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-56018dc2-1b97-4484-8942-fc91e058e26d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:03.628700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-56018dc2-1b97-4484-8942-fc91e058e26d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:03.629150 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-56018dc2-1b97-4484-8942-fc91e058e26d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:03.629962 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-56018dc2-1b97-4484-8942-fc91e058e26d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:03.630395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-56018dc2-1b97-4484-8942-fc91e058e26d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:03.729213 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-56018dc2-1b97-4484-8942-fc91e058e26d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.112530 Jan 17 02:43:03.730351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 605/1170] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:03 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:03.894774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4dfe3413-6d46-4e5a-abb2-755e1345990d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:03.896436 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4dfe3413-6d46-4e5a-abb2-755e1345990d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:03.909409 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dfe3413-6d46-4e5a-abb2-755e1345990d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:03.910149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dfe3413-6d46-4e5a-abb2-755e1345990d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:03.911434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dfe3413-6d46-4e5a-abb2-755e1345990d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:03.912147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dfe3413-6d46-4e5a-abb2-755e1345990d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:03.997799 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4dfe3413-6d46-4e5a-abb2-755e1345990d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.109466 Jan 17 02:43:03.998801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 566/1171] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:03 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:04.469782 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-362f3482-ea38-4a6e-afcb-01124e2a32c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:04.471427 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-362f3482-ea38-4a6e-afcb-01124e2a32c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:04.483107 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-362f3482-ea38-4a6e-afcb-01124e2a32c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:04.483852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-362f3482-ea38-4a6e-afcb-01124e2a32c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:04.485263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-362f3482-ea38-4a6e-afcb-01124e2a32c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:04.485985 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-362f3482-ea38-4a6e-afcb-01124e2a32c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:04.562850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-362f3482-ea38-4a6e-afcb-01124e2a32c6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/action" status: 202 len: 0 microversion: 2.1 time: 0.099766 Jan 17 02:43:04.563395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 606/1172] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:04 2022] POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:04.573213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:04.574012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:04.581039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:04.581467 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:04.582256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:04.582691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:04.744098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-287a7227-b98a-4925-940a-15f3e9785796 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:04.745120 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-287a7227-b98a-4925-940a-15f3e9785796 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:04.751831 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-287a7227-b98a-4925-940a-15f3e9785796 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:04.752316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-287a7227-b98a-4925-940a-15f3e9785796 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:04.753095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-287a7227-b98a-4925-940a-15f3e9785796 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:04.753527 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-287a7227-b98a-4925-940a-15f3e9785796 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:04.766552 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:04.776026 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-08810965-926e-4520-b046-1db57a991cd8 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1753 microversion: 2.1 time: 0.206362 Jan 17 02:43:04.776956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 567/1173] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:04 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:04.847259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-287a7227-b98a-4925-940a-15f3e9785796 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.107612 Jan 17 02:43:04.847954 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 607/1174] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:04 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:05.011093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a93a70a0-6c96-4f7e-a109-7195f5f6f6b3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:05.012104 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a93a70a0-6c96-4f7e-a109-7195f5f6f6b3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:05.019412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a93a70a0-6c96-4f7e-a109-7195f5f6f6b3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:05.019855 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a93a70a0-6c96-4f7e-a109-7195f5f6f6b3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:05.020730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a93a70a0-6c96-4f7e-a109-7195f5f6f6b3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:05.021158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a93a70a0-6c96-4f7e-a109-7195f5f6f6b3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:05.136608 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a93a70a0-6c96-4f7e-a109-7195f5f6f6b3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.129119 Jan 17 02:43:05.137294 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 568/1175] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:05 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:05.798591 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:05.799735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:05.808274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:05.808728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:05.809509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:05.809946 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:05.860677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-49b06a10-bcf0-433a-9ccd-6fbc95d3c684 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:05.861678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-49b06a10-bcf0-433a-9ccd-6fbc95d3c684 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:05.868778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49b06a10-bcf0-433a-9ccd-6fbc95d3c684 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:05.869225 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49b06a10-bcf0-433a-9ccd-6fbc95d3c684 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:05.870012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49b06a10-bcf0-433a-9ccd-6fbc95d3c684 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:05.870442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-49b06a10-bcf0-433a-9ccd-6fbc95d3c684 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:05.958120 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:05.966686 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-814a21cb-e7e6-429d-972e-e21375aabdb5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.174872 Jan 17 02:43:05.967439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 608/1176] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:05 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:05.972189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-49b06a10-bcf0-433a-9ccd-6fbc95d3c684 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.115506 Jan 17 02:43:05.972812 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 569/1177] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:05 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:06.147148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-81b7ba8e-66cd-4f37-8087-8fc1e6ff5700 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:06.148150 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-81b7ba8e-66cd-4f37-8087-8fc1e6ff5700 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:06.155363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81b7ba8e-66cd-4f37-8087-8fc1e6ff5700 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:06.155808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81b7ba8e-66cd-4f37-8087-8fc1e6ff5700 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:06.156617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81b7ba8e-66cd-4f37-8087-8fc1e6ff5700 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:06.157055 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-81b7ba8e-66cd-4f37-8087-8fc1e6ff5700 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:06.251773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-81b7ba8e-66cd-4f37-8087-8fc1e6ff5700 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.107855 Jan 17 02:43:06.252836 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 609/1178] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:06 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:06.988123 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8cf8bef9-26e4-4cbb-b61e-e35109755e2a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:06.989060 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:06.989731 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8cf8bef9-26e4-4cbb-b61e-e35109755e2a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:06.989944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:07.001509 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8cf8bef9-26e4-4cbb-b61e-e35109755e2a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:07.001830 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:07.002256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8cf8bef9-26e4-4cbb-b61e-e35109755e2a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:07.002530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:07.003559 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8cf8bef9-26e4-4cbb-b61e-e35109755e2a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:07.004009 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:07.004307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8cf8bef9-26e4-4cbb-b61e-e35109755e2a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:07.004768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:07.098198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8cf8bef9-26e4-4cbb-b61e-e35109755e2a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.116721 Jan 17 02:43:07.098917 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 570/1179] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:06 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:07.177492 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:07.185935 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-73abf70a-7d7c-4d41-a3f3-b5ec7235a637 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.203870 Jan 17 02:43:07.186497 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 610/1180] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:06 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:07.273567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f0c952f3-1505-49cc-a3cb-41e0a7cf0cd3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:07.274588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f0c952f3-1505-49cc-a3cb-41e0a7cf0cd3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:07.284655 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f0c952f3-1505-49cc-a3cb-41e0a7cf0cd3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:07.285236 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f0c952f3-1505-49cc-a3cb-41e0a7cf0cd3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:07.286407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f0c952f3-1505-49cc-a3cb-41e0a7cf0cd3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:07.287005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f0c952f3-1505-49cc-a3cb-41e0a7cf0cd3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:07.393186 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f0c952f3-1505-49cc-a3cb-41e0a7cf0cd3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 14 microversion: 2.1 time: 0.129726 Jan 17 02:43:07.394599 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 571/1181] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:07 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:43:08.115020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2b4c5908-34c0-4ff3-944f-dc68bf1972d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:08.116434 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2b4c5908-34c0-4ff3-944f-dc68bf1972d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:08.123177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b4c5908-34c0-4ff3-944f-dc68bf1972d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:08.123635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b4c5908-34c0-4ff3-944f-dc68bf1972d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:08.124440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b4c5908-34c0-4ff3-944f-dc68bf1972d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:08.124870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2b4c5908-34c0-4ff3-944f-dc68bf1972d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:08.203148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:08.203829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:08.211072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:08.211518 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:08.212332 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:08.212763 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:08.227820 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2b4c5908-34c0-4ff3-944f-dc68bf1972d8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.119127 Jan 17 02:43:08.228772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 611/1182] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:08 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:08.362578 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:08.374838 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-53a95a44-5707-4c16-b2e7-8ef96f4d97ee tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.175282 Jan 17 02:43:08.375614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 572/1183] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:08 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:08.412599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3eb583b0-f75d-4845-874e-1e6d45dc69e4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:08.413668 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3eb583b0-f75d-4845-874e-1e6d45dc69e4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:08.420728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3eb583b0-f75d-4845-874e-1e6d45dc69e4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:08.421176 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3eb583b0-f75d-4845-874e-1e6d45dc69e4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:08.421951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3eb583b0-f75d-4845-874e-1e6d45dc69e4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:08.422386 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3eb583b0-f75d-4845-874e-1e6d45dc69e4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:08.527010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3eb583b0-f75d-4845-874e-1e6d45dc69e4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 6882 microversion: 2.1 time: 0.117945 Jan 17 02:43:08.528133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 612/1184] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:08 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 6882 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:09.243212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-eacf6926-9b6a-4838-88ef-64482717e2ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:09.244899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-eacf6926-9b6a-4838-88ef-64482717e2ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:09.255573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eacf6926-9b6a-4838-88ef-64482717e2ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:09.256366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eacf6926-9b6a-4838-88ef-64482717e2ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:09.257374 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eacf6926-9b6a-4838-88ef-64482717e2ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:09.257803 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eacf6926-9b6a-4838-88ef-64482717e2ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:09.350368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-eacf6926-9b6a-4838-88ef-64482717e2ea tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.112914 Jan 17 02:43:09.351383 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 573/1185] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:09 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:09.395572 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:09.396345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:09.404216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:09.404673 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:09.405461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:09.405895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:09.540040 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c93a1b7d-af56-4540-9f54-e49347a2fefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:09.541098 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c93a1b7d-af56-4540-9f54-e49347a2fefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:09.548242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c93a1b7d-af56-4540-9f54-e49347a2fefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:09.548685 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c93a1b7d-af56-4540-9f54-e49347a2fefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:09.549469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c93a1b7d-af56-4540-9f54-e49347a2fefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:09.549898 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c93a1b7d-af56-4540-9f54-e49347a2fefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:09.562439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:09.570640 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-99e7d33e-d296-4953-b0a4-c8f857641d94 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.179423 Jan 17 02:43:09.571244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 613/1186] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:09 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:09.648730 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c93a1b7d-af56-4540-9f54-e49347a2fefd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 15025 microversion: 2.1 time: 0.112168 Jan 17 02:43:09.649712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 574/1187] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:09 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 15025 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:10.367520 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7ca12aaa-fd00-4762-81b9-9ae88e9c2213 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:10.368502 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7ca12aaa-fd00-4762-81b9-9ae88e9c2213 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:10.375322 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7ca12aaa-fd00-4762-81b9-9ae88e9c2213 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:10.375777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7ca12aaa-fd00-4762-81b9-9ae88e9c2213 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:10.376608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7ca12aaa-fd00-4762-81b9-9ae88e9c2213 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:10.377038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7ca12aaa-fd00-4762-81b9-9ae88e9c2213 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:10.480242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7ca12aaa-fd00-4762-81b9-9ae88e9c2213 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.117703 Jan 17 02:43:10.481968 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 614/1188] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:10 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:10.592814 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:10.594045 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:10.603904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:10.604380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:10.605158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:10.605591 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:10.663378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-324982b2-cef2-4bb4-b1b5-171526804341 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:10.664493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-324982b2-cef2-4bb4-b1b5-171526804341 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:10.672037 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-324982b2-cef2-4bb4-b1b5-171526804341 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:10.672545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-324982b2-cef2-4bb4-b1b5-171526804341 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:10.673337 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-324982b2-cef2-4bb4-b1b5-171526804341 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:10.673775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-324982b2-cef2-4bb4-b1b5-171526804341 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:10.764533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:10.776612 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-64752127-cc1e-4f99-bb4f-90f2d976e0dc tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.190352 Jan 17 02:43:10.777324 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 575/1189] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:10 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:10.786210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-324982b2-cef2-4bb4-b1b5-171526804341 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 18305 microversion: 2.1 time: 0.126807 Jan 17 02:43:10.786857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 615/1190] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:10 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 18305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:11.498416 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0b19e7d3-6977-4fd4-80bf-635973d70fb4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:11.499791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0b19e7d3-6977-4fd4-80bf-635973d70fb4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:11.509471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b19e7d3-6977-4fd4-80bf-635973d70fb4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:11.509927 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b19e7d3-6977-4fd4-80bf-635973d70fb4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:11.510714 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b19e7d3-6977-4fd4-80bf-635973d70fb4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:11.511152 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0b19e7d3-6977-4fd4-80bf-635973d70fb4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:11.612365 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0b19e7d3-6977-4fd4-80bf-635973d70fb4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.119712 Jan 17 02:43:11.613405 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 576/1191] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:11 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:11.800165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:11.801316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:11.802191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-82f12378-6084-46a1-aeeb-6b7c3582635f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:11.806218 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-82f12378-6084-46a1-aeeb-6b7c3582635f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:11.810480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:11.811237 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:11.812057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:11.812598 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:11.813611 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82f12378-6084-46a1-aeeb-6b7c3582635f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:11.814046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82f12378-6084-46a1-aeeb-6b7c3582635f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:11.814835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82f12378-6084-46a1-aeeb-6b7c3582635f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:11.815447 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-82f12378-6084-46a1-aeeb-6b7c3582635f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:11.922114 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-82f12378-6084-46a1-aeeb-6b7c3582635f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 19342 microversion: 2.1 time: 0.126387 Jan 17 02:43:11.922759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 577/1192] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:11 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 19342 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:11.960733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:11.968624 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-22431d97-2a30-4427-8baf-eafe9211597d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.175379 Jan 17 02:43:11.969226 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 616/1193] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:11 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:12.631124 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7d06a858-ff25-4578-8a23-da844f127b8e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:12.633103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7d06a858-ff25-4578-8a23-da844f127b8e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:12.644959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d06a858-ff25-4578-8a23-da844f127b8e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:12.645711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d06a858-ff25-4578-8a23-da844f127b8e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:12.647002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d06a858-ff25-4578-8a23-da844f127b8e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:12.647732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d06a858-ff25-4578-8a23-da844f127b8e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:12.739805 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7d06a858-ff25-4578-8a23-da844f127b8e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.115045 Jan 17 02:43:12.740762 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 578/1194] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:12 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:12.937944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-03c3618c-3c62-42a0-8f74-de7e30c78cc1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:12.939326 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-03c3618c-3c62-42a0-8f74-de7e30c78cc1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:12.948341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03c3618c-3c62-42a0-8f74-de7e30c78cc1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:12.948796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03c3618c-3c62-42a0-8f74-de7e30c78cc1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:12.949570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03c3618c-3c62-42a0-8f74-de7e30c78cc1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:12.950004 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-03c3618c-3c62-42a0-8f74-de7e30c78cc1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:12.986370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:12.987056 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:12.994284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:12.994700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:12.995500 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:12.995926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:13.048911 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-03c3618c-3c62-42a0-8f74-de7e30c78cc1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 21813 microversion: 2.1 time: 0.117297 Jan 17 02:43:13.049626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 617/1195] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:12 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 21813 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:13.150999 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:13.159383 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-59430927-3ce3-4561-8c39-6da14e544ddf tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.177197 Jan 17 02:43:13.159944 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 579/1196] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:12 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:43:13.754733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-780cc199-9da7-411f-8986-b50b09d30a46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:13.755988 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-780cc199-9da7-411f-8986-b50b09d30a46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:13.763782 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-780cc199-9da7-411f-8986-b50b09d30a46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:13.764288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-780cc199-9da7-411f-8986-b50b09d30a46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:13.765080 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-780cc199-9da7-411f-8986-b50b09d30a46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:13.765536 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-780cc199-9da7-411f-8986-b50b09d30a46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:13.859234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-780cc199-9da7-411f-8986-b50b09d30a46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.109094 Jan 17 02:43:13.860245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 618/1197] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:13 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:14.064766 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4e51feb1-6d34-4480-83dd-b9b9fbd36340 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:14.066134 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4e51feb1-6d34-4480-83dd-b9b9fbd36340 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:14.076744 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4e51feb1-6d34-4480-83dd-b9b9fbd36340 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:14.077487 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4e51feb1-6d34-4480-83dd-b9b9fbd36340 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:14.078753 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4e51feb1-6d34-4480-83dd-b9b9fbd36340 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:14.079472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4e51feb1-6d34-4480-83dd-b9b9fbd36340 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:14.180810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:14.181663 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:14.190298 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:14.190860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:14.191431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4e51feb1-6d34-4480-83dd-b9b9fbd36340 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 23221 microversion: 2.1 time: 0.132602 Jan 17 02:43:14.191816 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:14.192227 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 580/1198] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:14 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 23221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:14.192421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:14.349109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:14.357803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e2b96c7e-945a-41d6-a753-f4fa0614e9d6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.183471 Jan 17 02:43:14.358395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 619/1199] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:14 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 02:43:14.878511 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a758327f-cf7f-4e29-9373-0e63bc78f89f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:14.880012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a758327f-cf7f-4e29-9373-0e63bc78f89f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:14.891562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a758327f-cf7f-4e29-9373-0e63bc78f89f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:14.892388 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a758327f-cf7f-4e29-9373-0e63bc78f89f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:14.893678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a758327f-cf7f-4e29-9373-0e63bc78f89f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:14.894401 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a758327f-cf7f-4e29-9373-0e63bc78f89f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:14.988444 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a758327f-cf7f-4e29-9373-0e63bc78f89f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.116349 Jan 17 02:43:14.989453 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 581/1200] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:14 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:15.204219 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-47f00090-c362-49e5-8176-8f08bf5bd141 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:15.205141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-47f00090-c362-49e5-8176-8f08bf5bd141 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:15.211866 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47f00090-c362-49e5-8176-8f08bf5bd141 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:15.212328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47f00090-c362-49e5-8176-8f08bf5bd141 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:15.213109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47f00090-c362-49e5-8176-8f08bf5bd141 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:15.213547 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47f00090-c362-49e5-8176-8f08bf5bd141 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:15.349810 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-47f00090-c362-49e5-8176-8f08bf5bd141 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 24291 microversion: 2.1 time: 0.148687 Jan 17 02:43:15.350872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 620/1201] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:15 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 24291 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:15.375259 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:15.376702 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:15.383880 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:15.384710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:15.385499 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:15.385938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:15.541473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:15.549833 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-913a9ae4-5cd3-46c5-9f06-2f307f7a0583 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1758 microversion: 2.1 time: 0.178755 Jan 17 02:43:15.550407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 582/1202] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:15 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:16.007224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5bda56ab-aed4-4bbf-b735-bee9d09b8949 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:16.008501 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5bda56ab-aed4-4bbf-b735-bee9d09b8949 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:16.015589 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5bda56ab-aed4-4bbf-b735-bee9d09b8949 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:16.016040 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5bda56ab-aed4-4bbf-b735-bee9d09b8949 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:16.016855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5bda56ab-aed4-4bbf-b735-bee9d09b8949 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:16.017292 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5bda56ab-aed4-4bbf-b735-bee9d09b8949 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:16.164253 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5bda56ab-aed4-4bbf-b735-bee9d09b8949 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.163740 Jan 17 02:43:16.165296 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 621/1203] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:15 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:16.366008 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-97936ed4-7f35-4d42-b922-b7dcc787f2f6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:16.367251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-97936ed4-7f35-4d42-b922-b7dcc787f2f6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:16.373796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97936ed4-7f35-4d42-b922-b7dcc787f2f6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:16.374252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97936ed4-7f35-4d42-b922-b7dcc787f2f6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:16.375032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97936ed4-7f35-4d42-b922-b7dcc787f2f6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:16.375510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97936ed4-7f35-4d42-b922-b7dcc787f2f6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:16.480327 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-97936ed4-7f35-4d42-b922-b7dcc787f2f6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 25406 microversion: 2.1 time: 0.119681 Jan 17 02:43:16.481226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 583/1204] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:16 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 25406 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:16.571190 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:16.571887 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:16.579147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:16.579602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:16.580438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:16.580873 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:16.733883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:16.746130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b61cd4c6-73eb-4ed5-8838-59a12d69c350 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1761 microversion: 2.1 time: 0.181080 Jan 17 02:43:16.746957 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 622/1205] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:43:16 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:43:17.187745 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ce445577-c919-481e-8dc7-e4094ec8782c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:17.190367 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ce445577-c919-481e-8dc7-e4094ec8782c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:17.203658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce445577-c919-481e-8dc7-e4094ec8782c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:17.204175 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce445577-c919-481e-8dc7-e4094ec8782c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:17.205249 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce445577-c919-481e-8dc7-e4094ec8782c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:17.205822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ce445577-c919-481e-8dc7-e4094ec8782c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:17.311362 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ce445577-c919-481e-8dc7-e4094ec8782c tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 28636 microversion: 2.20 time: 0.133241 Jan 17 02:43:17.312299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 584/1206] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:17 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 28636 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:17.498115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4f6c8c3e-6e57-4f10-8de3-fc66a491fb12 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:17.499456 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4f6c8c3e-6e57-4f10-8de3-fc66a491fb12 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:17.509325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f6c8c3e-6e57-4f10-8de3-fc66a491fb12 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:17.509760 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f6c8c3e-6e57-4f10-8de3-fc66a491fb12 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:17.510534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f6c8c3e-6e57-4f10-8de3-fc66a491fb12 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:17.510965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4f6c8c3e-6e57-4f10-8de3-fc66a491fb12 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:17.626325 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4f6c8c3e-6e57-4f10-8de3-fc66a491fb12 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 26704 microversion: 2.1 time: 0.134221 Jan 17 02:43:17.627452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 623/1207] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:17 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 26704 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:18.324917 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1c3e51bd-7c0e-42f0-992d-9edcfa5f596a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:18.325917 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1c3e51bd-7c0e-42f0-992d-9edcfa5f596a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:18.333297 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1c3e51bd-7c0e-42f0-992d-9edcfa5f596a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:18.333743 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1c3e51bd-7c0e-42f0-992d-9edcfa5f596a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:18.334529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1c3e51bd-7c0e-42f0-992d-9edcfa5f596a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:18.334960 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1c3e51bd-7c0e-42f0-992d-9edcfa5f596a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:18.443867 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1c3e51bd-7c0e-42f0-992d-9edcfa5f596a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 29581 microversion: 2.20 time: 0.123187 Jan 17 02:43:18.444556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 585/1208] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:18 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 29581 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:18.644975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e69ce22b-e91b-4b74-aabc-0ef96cbc6c9a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:18.646603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e69ce22b-e91b-4b74-aabc-0ef96cbc6c9a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:18.655789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69ce22b-e91b-4b74-aabc-0ef96cbc6c9a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:18.656291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69ce22b-e91b-4b74-aabc-0ef96cbc6c9a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:18.657075 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69ce22b-e91b-4b74-aabc-0ef96cbc6c9a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:18.657514 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e69ce22b-e91b-4b74-aabc-0ef96cbc6c9a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:18.768206 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e69ce22b-e91b-4b74-aabc-0ef96cbc6c9a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 27519 microversion: 2.1 time: 0.129486 Jan 17 02:43:18.769201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 624/1209] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:18 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 27519 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:19.459923 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a4ff6f99-597b-4350-b5a0-774453ec620b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:19.461572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a4ff6f99-597b-4350-b5a0-774453ec620b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:19.473162 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4ff6f99-597b-4350-b5a0-774453ec620b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:19.473914 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4ff6f99-597b-4350-b5a0-774453ec620b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:19.475179 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4ff6f99-597b-4350-b5a0-774453ec620b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:19.475890 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a4ff6f99-597b-4350-b5a0-774453ec620b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:19.579916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a4ff6f99-597b-4350-b5a0-774453ec620b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 31427 microversion: 2.20 time: 0.126135 Jan 17 02:43:19.580875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 586/1210] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:19 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 31427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:19.787159 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-dbd5b213-bf53-4b4c-baed-b73c8be3a715 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:19.788736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-dbd5b213-bf53-4b4c-baed-b73c8be3a715 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:19.796794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbd5b213-bf53-4b4c-baed-b73c8be3a715 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:19.797240 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbd5b213-bf53-4b4c-baed-b73c8be3a715 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:19.798019 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbd5b213-bf53-4b4c-baed-b73c8be3a715 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:19.798452 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-dbd5b213-bf53-4b4c-baed-b73c8be3a715 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:19.910871 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-dbd5b213-bf53-4b4c-baed-b73c8be3a715 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 27819 microversion: 2.1 time: 0.129434 Jan 17 02:43:19.911850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 625/1211] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:19 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 27819 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:20.599489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-eb65d25d-1adc-4234-860a-8fc5f265248d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:20.601035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-eb65d25d-1adc-4234-860a-8fc5f265248d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:20.612555 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eb65d25d-1adc-4234-860a-8fc5f265248d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:20.613310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eb65d25d-1adc-4234-860a-8fc5f265248d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:20.614600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eb65d25d-1adc-4234-860a-8fc5f265248d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:20.615322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-eb65d25d-1adc-4234-860a-8fc5f265248d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:20.734306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-eb65d25d-1adc-4234-860a-8fc5f265248d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 33081 microversion: 2.20 time: 0.141389 Jan 17 02:43:20.735325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 587/1212] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:20 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 33081 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:20.929838 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-821318d7-d2c5-4920-a8c9-62a305b134a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:20.931473 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-821318d7-d2c5-4920-a8c9-62a305b134a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:20.942658 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-821318d7-d2c5-4920-a8c9-62a305b134a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:20.943402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-821318d7-d2c5-4920-a8c9-62a305b134a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:20.944750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-821318d7-d2c5-4920-a8c9-62a305b134a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:20.945471 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-821318d7-d2c5-4920-a8c9-62a305b134a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:21.062803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-821318d7-d2c5-4920-a8c9-62a305b134a9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.139376 Jan 17 02:43:21.063852 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 626/1213] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:20 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:21.751186 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5d429fd3-fc8a-40f7-9157-795c8dcfc727 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:21.752440 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5d429fd3-fc8a-40f7-9157-795c8dcfc727 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:21.760756 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5d429fd3-fc8a-40f7-9157-795c8dcfc727 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:21.761218 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5d429fd3-fc8a-40f7-9157-795c8dcfc727 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:21.761997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5d429fd3-fc8a-40f7-9157-795c8dcfc727 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:21.762425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5d429fd3-fc8a-40f7-9157-795c8dcfc727 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:21.864658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5d429fd3-fc8a-40f7-9157-795c8dcfc727 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 33958 microversion: 2.20 time: 0.118162 Jan 17 02:43:21.865560 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 588/1214] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:21 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 33958 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:22.082144 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7f384b6f-ec56-494a-980f-446595d0d1fd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:22.083700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7f384b6f-ec56-494a-980f-446595d0d1fd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:22.093044 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f384b6f-ec56-494a-980f-446595d0d1fd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:22.093487 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f384b6f-ec56-494a-980f-446595d0d1fd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:22.094272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f384b6f-ec56-494a-980f-446595d0d1fd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:22.094702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7f384b6f-ec56-494a-980f-446595d0d1fd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:22.185970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7f384b6f-ec56-494a-980f-446595d0d1fd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.110292 Jan 17 02:43:22.186967 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 627/1215] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:22 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:22.883838 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a7063b3d-02b6-44db-b16e-535bb77e05a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:22.885505 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a7063b3d-02b6-44db-b16e-535bb77e05a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:22.897098 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7063b3d-02b6-44db-b16e-535bb77e05a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:22.897849 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7063b3d-02b6-44db-b16e-535bb77e05a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:22.899140 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7063b3d-02b6-44db-b16e-535bb77e05a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:22.899861 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a7063b3d-02b6-44db-b16e-535bb77e05a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:23.000794 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a7063b3d-02b6-44db-b16e-535bb77e05a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 35166 microversion: 2.20 time: 0.123493 Jan 17 02:43:23.001508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 589/1216] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:22 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 35166 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:23.205199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d827001e-8abe-49e7-899a-ece46b82b238 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:23.206723 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d827001e-8abe-49e7-899a-ece46b82b238 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:23.218193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d827001e-8abe-49e7-899a-ece46b82b238 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:23.218937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d827001e-8abe-49e7-899a-ece46b82b238 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:23.220260 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d827001e-8abe-49e7-899a-ece46b82b238 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:23.220977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d827001e-8abe-49e7-899a-ece46b82b238 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:23.323318 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d827001e-8abe-49e7-899a-ece46b82b238 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.124612 Jan 17 02:43:23.324121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 628/1217] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:23 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:24.018582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bfa5737b-44d4-4ea6-ba4d-b9a5986ab590 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:24.020230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bfa5737b-44d4-4ea6-ba4d-b9a5986ab590 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:24.031942 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfa5737b-44d4-4ea6-ba4d-b9a5986ab590 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:24.032734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfa5737b-44d4-4ea6-ba4d-b9a5986ab590 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:24.034079 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfa5737b-44d4-4ea6-ba4d-b9a5986ab590 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:24.034749 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfa5737b-44d4-4ea6-ba4d-b9a5986ab590 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:24.181676 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bfa5737b-44d4-4ea6-ba4d-b9a5986ab590 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 36586 microversion: 2.20 time: 0.169672 Jan 17 02:43:24.182681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 590/1218] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:24 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 36586 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:24.339547 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c6e5c754-794d-46b5-996a-f0f90dcb0af2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:24.340747 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c6e5c754-794d-46b5-996a-f0f90dcb0af2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:24.349556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6e5c754-794d-46b5-996a-f0f90dcb0af2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:24.350123 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6e5c754-794d-46b5-996a-f0f90dcb0af2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:24.351098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6e5c754-794d-46b5-996a-f0f90dcb0af2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:24.351649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c6e5c754-794d-46b5-996a-f0f90dcb0af2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:24.441264 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c6e5c754-794d-46b5-996a-f0f90dcb0af2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.108037 Jan 17 02:43:24.442258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 629/1219] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:24 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:25.200703 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0895141d-409f-4d64-be52-c2f301c662cf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:25.202372 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0895141d-409f-4d64-be52-c2f301c662cf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:25.213993 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0895141d-409f-4d64-be52-c2f301c662cf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:25.214752 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0895141d-409f-4d64-be52-c2f301c662cf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:25.216003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0895141d-409f-4d64-be52-c2f301c662cf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:25.216475 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0895141d-409f-4d64-be52-c2f301c662cf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:25.331005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0895141d-409f-4d64-be52-c2f301c662cf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 38169 microversion: 2.20 time: 0.136604 Jan 17 02:43:25.332053 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 591/1220] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:25 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 38169 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:25.460305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5f727e09-f6fe-44ac-95ea-4ec363a00c7f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:25.461801 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5f727e09-f6fe-44ac-95ea-4ec363a00c7f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:25.474460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f727e09-f6fe-44ac-95ea-4ec363a00c7f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:25.474965 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f727e09-f6fe-44ac-95ea-4ec363a00c7f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:25.476644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f727e09-f6fe-44ac-95ea-4ec363a00c7f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:25.477360 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5f727e09-f6fe-44ac-95ea-4ec363a00c7f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:25.573197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5f727e09-f6fe-44ac-95ea-4ec363a00c7f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.119198 Jan 17 02:43:25.574169 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 630/1221] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:25 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:26.348177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cad1282d-5416-4bd2-89eb-18e9789f20d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:26.349409 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cad1282d-5416-4bd2-89eb-18e9789f20d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:26.358122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cad1282d-5416-4bd2-89eb-18e9789f20d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:26.358569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cad1282d-5416-4bd2-89eb-18e9789f20d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:26.359343 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cad1282d-5416-4bd2-89eb-18e9789f20d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:26.359770 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cad1282d-5416-4bd2-89eb-18e9789f20d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:26.458897 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cad1282d-5416-4bd2-89eb-18e9789f20d3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 38190 microversion: 2.20 time: 0.115338 Jan 17 02:43:26.460036 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 592/1222] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:26 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 38190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:26.590475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0d5c0255-e001-4511-a62e-6717548b04d1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:26.592010 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-0d5c0255-e001-4511-a62e-6717548b04d1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:26.600405 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d5c0255-e001-4511-a62e-6717548b04d1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:26.600933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d5c0255-e001-4511-a62e-6717548b04d1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:26.601893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d5c0255-e001-4511-a62e-6717548b04d1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:26.602408 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-0d5c0255-e001-4511-a62e-6717548b04d1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:26.707346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0d5c0255-e001-4511-a62e-6717548b04d1 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.123407 Jan 17 02:43:26.708327 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 631/1223] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:26 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:27.474882 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dad6c9f2-6f59-447c-b5bf-b5395d86d523 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:27.475907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dad6c9f2-6f59-447c-b5bf-b5395d86d523 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:27.483541 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dad6c9f2-6f59-447c-b5bf-b5395d86d523 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:27.483995 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dad6c9f2-6f59-447c-b5bf-b5395d86d523 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:27.484821 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dad6c9f2-6f59-447c-b5bf-b5395d86d523 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:27.485260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dad6c9f2-6f59-447c-b5bf-b5395d86d523 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:27.578412 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dad6c9f2-6f59-447c-b5bf-b5395d86d523 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 38190 microversion: 2.20 time: 0.107226 Jan 17 02:43:27.579073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 593/1224] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:27 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 38190 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:27.722266 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d7ff177d-db24-41e1-8f53-03ce1443c333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:27.723289 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d7ff177d-db24-41e1-8f53-03ce1443c333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:27.732164 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d7ff177d-db24-41e1-8f53-03ce1443c333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:27.732630 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d7ff177d-db24-41e1-8f53-03ce1443c333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:27.733479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d7ff177d-db24-41e1-8f53-03ce1443c333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:27.733869 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d7ff177d-db24-41e1-8f53-03ce1443c333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:27.842163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d7ff177d-db24-41e1-8f53-03ce1443c333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.123405 Jan 17 02:43:27.843069 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 632/1225] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:27 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:28.596891 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b50495cb-c3ad-48ea-8ea9-793251e723de tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:28.598441 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b50495cb-c3ad-48ea-8ea9-793251e723de tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:28.608984 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b50495cb-c3ad-48ea-8ea9-793251e723de tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:28.609435 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b50495cb-c3ad-48ea-8ea9-793251e723de tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:28.610218 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b50495cb-c3ad-48ea-8ea9-793251e723de tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:28.610652 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b50495cb-c3ad-48ea-8ea9-793251e723de tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:28.713437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b50495cb-c3ad-48ea-8ea9-793251e723de tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 38190 microversion: 2.20 time: 0.123186 Jan 17 02:43:28.714459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 594/1226] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:28 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 38190 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:28.861608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1762177c-8842-4e15-b7dc-b0c3e68ed770 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:28.863109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1762177c-8842-4e15-b7dc-b0c3e68ed770 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:28.873581 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1762177c-8842-4e15-b7dc-b0c3e68ed770 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:28.874036 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1762177c-8842-4e15-b7dc-b0c3e68ed770 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:28.874826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1762177c-8842-4e15-b7dc-b0c3e68ed770 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:28.875259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1762177c-8842-4e15-b7dc-b0c3e68ed770 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:28.975738 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1762177c-8842-4e15-b7dc-b0c3e68ed770 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.120604 Jan 17 02:43:28.976832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 633/1227] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:28 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:29.731864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e0baa970-a16f-4e45-be60-b08de9ffc948 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:29.732308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e0baa970-a16f-4e45-be60-b08de9ffc948 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:29.740717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0baa970-a16f-4e45-be60-b08de9ffc948 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:29.741335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0baa970-a16f-4e45-be60-b08de9ffc948 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:29.742491 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0baa970-a16f-4e45-be60-b08de9ffc948 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:29.743012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e0baa970-a16f-4e45-be60-b08de9ffc948 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:29.849856 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e0baa970-a16f-4e45-be60-b08de9ffc948 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 200 len: 38331 microversion: 2.20 time: 0.123878 Jan 17 02:43:29.850870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 595/1228] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:29 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 38331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:43:29.863694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f2be72ea-bec0-4d74-b8e7-54998f5619b7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:29.864265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f2be72ea-bec0-4d74-b8e7-54998f5619b7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:29.871848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f2be72ea-bec0-4d74-b8e7-54998f5619b7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:29.872480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f2be72ea-bec0-4d74-b8e7-54998f5619b7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:29.873277 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f2be72ea-bec0-4d74-b8e7-54998f5619b7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:29.873706 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f2be72ea-bec0-4d74-b8e7-54998f5619b7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:29.897555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f2be72ea-bec0-4d74-b8e7-54998f5619b7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/ips" status: 200 len: 153 microversion: 2.20 time: 0.037897 Jan 17 02:43:29.898111 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 634/1229] 10.222.0.24 () {60 vars in 1288 bytes} [Mon Jan 17 02:43:29 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:29.990495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e82e8939-08cc-46d5-abe9-af0ad0002c8c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:29.991437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e82e8939-08cc-46d5-abe9-af0ad0002c8c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:29.998562 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e82e8939-08cc-46d5-abe9-af0ad0002c8c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:29.999011 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e82e8939-08cc-46d5-abe9-af0ad0002c8c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:29.999792 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e82e8939-08cc-46d5-abe9-af0ad0002c8c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:30.000262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e82e8939-08cc-46d5-abe9-af0ad0002c8c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:30.097928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e82e8939-08cc-46d5-abe9-af0ad0002c8c tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.111358 Jan 17 02:43:30.100219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 596/1230] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:29 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:31.111276 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-54ea90ca-3ce0-4d42-9a22-376d882c4333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:31.112217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-54ea90ca-3ce0-4d42-9a22-376d882c4333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:31.122867 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-54ea90ca-3ce0-4d42-9a22-376d882c4333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:31.123306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-54ea90ca-3ce0-4d42-9a22-376d882c4333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:31.124108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-54ea90ca-3ce0-4d42-9a22-376d882c4333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:31.124622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-54ea90ca-3ce0-4d42-9a22-376d882c4333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:31.226232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-54ea90ca-3ce0-4d42-9a22-376d882c4333 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.118456 Jan 17 02:43:31.226881 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 635/1231] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:31 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:32.045510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:32.046375 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:32.054298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:32.054759 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:32.055540 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:32.055976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:32.079387 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lazy-loading 'flavor' on Instance uuid 834bc0c3-4bde-484a-8d9b-aab060aac09b {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:43:32.238877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fdeda09f-df86-49f4-841b-1629918ff1af tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:32.239897 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fdeda09f-df86-49f4-841b-1629918ff1af tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:32.247680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fdeda09f-df86-49f4-841b-1629918ff1af tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:32.248160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fdeda09f-df86-49f4-841b-1629918ff1af tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:32.248964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fdeda09f-df86-49f4-841b-1629918ff1af tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:32.249404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fdeda09f-df86-49f4-841b-1629918ff1af tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:32.333988 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fdeda09f-df86-49f4-841b-1629918ff1af tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.099185 Jan 17 02:43:32.334633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 636/1232] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:32 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:32.339082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b89128b4-8b13-443b-9dc9-f3933f1a07b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 202 len: 0 microversion: 2.20 time: 0.300552 Jan 17 02:43:32.339771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 597/1233] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:43:32 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:43:32.349462 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:32.350180 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:32.357611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:32.358063 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:32.359034 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:32.359515 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:32.502644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:32.510605 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:32.512095 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:32.513278 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fec2c452-e862-4830-8112-128ad4255c0a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.167793 Jan 17 02:43:32.513838 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 637/1234] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:32 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:33.349279 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-6eafe556-7a9c-4777-8524-732bb463abde tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:33.350267 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-6eafe556-7a9c-4777-8524-732bb463abde tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:33.359325 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6eafe556-7a9c-4777-8524-732bb463abde tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:33.360032 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6eafe556-7a9c-4777-8524-732bb463abde tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:33.361331 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6eafe556-7a9c-4777-8524-732bb463abde tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:33.361935 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-6eafe556-7a9c-4777-8524-732bb463abde tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:33.455419 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-6eafe556-7a9c-4777-8524-732bb463abde tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.111069 Jan 17 02:43:33.456060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 598/1235] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:33 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:33.535647 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:33.536591 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:33.547391 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:33.548185 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:33.548971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:33.549403 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:33.685724 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:33.693602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:33.695074 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:33.696250 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-acece997-721c-4058-b2e1-4cf5ec362835 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.166911 Jan 17 02:43:33.696849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 638/1236] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:33 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:34.472267 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a3ea1f53-4ae4-455e-b278-4ab5a31d3c42 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:34.473768 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a3ea1f53-4ae4-455e-b278-4ab5a31d3c42 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:34.485398 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3ea1f53-4ae4-455e-b278-4ab5a31d3c42 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:34.485865 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3ea1f53-4ae4-455e-b278-4ab5a31d3c42 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:34.486643 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3ea1f53-4ae4-455e-b278-4ab5a31d3c42 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:34.487071 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3ea1f53-4ae4-455e-b278-4ab5a31d3c42 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:34.581092 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a3ea1f53-4ae4-455e-b278-4ab5a31d3c42 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28186 microversion: 2.1 time: 0.115567 Jan 17 02:43:34.581837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 599/1237] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:34 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28186 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:34.718457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:34.719466 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:34.727171 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:34.727609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:34.728516 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:34.729005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:34.887492 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:34.896053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:34.897551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:34.898693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b8b83eba-3f07-44b5-8a50-8b92170ee8c7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.186539 Jan 17 02:43:34.899246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 639/1238] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:34 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:35.594623 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-56817603-f8bc-4763-b1d4-4edeaf4f9a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:35.595537 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-56817603-f8bc-4763-b1d4-4edeaf4f9a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:35.602813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-56817603-f8bc-4763-b1d4-4edeaf4f9a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:35.603268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-56817603-f8bc-4763-b1d4-4edeaf4f9a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:35.604050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-56817603-f8bc-4763-b1d4-4edeaf4f9a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:35.604524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-56817603-f8bc-4763-b1d4-4edeaf4f9a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:35.713529 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-56817603-f8bc-4763-b1d4-4edeaf4f9a3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28477 microversion: 2.1 time: 0.122850 Jan 17 02:43:35.714266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 600/1239] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:35 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28477 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:35.921794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:35.922878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:35.929997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:35.930470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:35.931277 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:35.931729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:36.075568 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:36.085356 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:36.086832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:36.087980 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cb45be98-d56d-4d99-9388-81d425aafa84 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.172552 Jan 17 02:43:36.088654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 640/1240] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:35 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:36.731904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ef09e50a-be0d-40a4-ae9b-379ac849a6cc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:36.733621 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ef09e50a-be0d-40a4-ae9b-379ac849a6cc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:36.741523 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef09e50a-be0d-40a4-ae9b-379ac849a6cc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:36.741972 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef09e50a-be0d-40a4-ae9b-379ac849a6cc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:36.742763 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef09e50a-be0d-40a4-ae9b-379ac849a6cc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:36.743202 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ef09e50a-be0d-40a4-ae9b-379ac849a6cc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:36.863428 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ef09e50a-be0d-40a4-ae9b-379ac849a6cc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28530 microversion: 2.1 time: 0.137763 Jan 17 02:43:36.864484 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 601/1241] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:36 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28530 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:37.110353 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:37.111193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:37.121823 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:37.122582 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:37.123851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:37.124625 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:37.264166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:37.272639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:37.274110 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:37.275631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6414945a-7596-413d-97e2-9d9712d6ae9b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.171812 Jan 17 02:43:37.276197 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 641/1242] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:37 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:37.882967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2fef0251-9308-4ee0-8cbd-67bf64a20223 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:37.884851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2fef0251-9308-4ee0-8cbd-67bf64a20223 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:37.896572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2fef0251-9308-4ee0-8cbd-67bf64a20223 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:37.897482 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2fef0251-9308-4ee0-8cbd-67bf64a20223 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:37.898778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2fef0251-9308-4ee0-8cbd-67bf64a20223 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:37.899530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2fef0251-9308-4ee0-8cbd-67bf64a20223 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:37.997913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2fef0251-9308-4ee0-8cbd-67bf64a20223 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.121262 Jan 17 02:43:37.998863 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 602/1243] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:37 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:38.297588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:38.298316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:38.305079 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:38.305528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:38.306341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:38.306769 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:38.445970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:38.454070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:38.455522 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:38.456781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-41c9f4d4-a9c1-4670-9829-2d6dd54e6af8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.165185 Jan 17 02:43:38.457342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 642/1244] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:38 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:39.012381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-df332fc7-8a47-4ac2-be58-e2722dbf028a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:39.013011 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-df332fc7-8a47-4ac2-be58-e2722dbf028a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:39.019930 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df332fc7-8a47-4ac2-be58-e2722dbf028a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:39.020408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df332fc7-8a47-4ac2-be58-e2722dbf028a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:39.021273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df332fc7-8a47-4ac2-be58-e2722dbf028a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:39.021713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-df332fc7-8a47-4ac2-be58-e2722dbf028a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:39.113503 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-df332fc7-8a47-4ac2-be58-e2722dbf028a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.105899 Jan 17 02:43:39.114171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 603/1245] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:39 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:39.476168 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:39.476803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:39.484396 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:39.484845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:39.485620 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:39.486053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:39.622239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:39.630564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:39.632048 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:39.633212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3d03856b-2c8a-4bc6-98e9-ce800d7a1c93 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.160990 Jan 17 02:43:39.634423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 643/1246] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:39 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:40.129275 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bb07394e-da1a-4859-bcc2-218fd1d5ae3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:40.130340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bb07394e-da1a-4859-bcc2-218fd1d5ae3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:40.138097 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb07394e-da1a-4859-bcc2-218fd1d5ae3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:40.138577 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb07394e-da1a-4859-bcc2-218fd1d5ae3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:40.139324 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb07394e-da1a-4859-bcc2-218fd1d5ae3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:40.139978 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb07394e-da1a-4859-bcc2-218fd1d5ae3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:40.244055 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bb07394e-da1a-4859-bcc2-218fd1d5ae3b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.120162 Jan 17 02:43:40.245102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 604/1247] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:40 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:40.658974 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:40.659642 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:40.667064 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:40.667560 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:40.668448 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:40.668928 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:40.807630 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:40.816232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:40.817706 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:40.818859 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d5364ea6-afeb-4175-9859-70d69e602900 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.166159 Jan 17 02:43:40.819421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 644/1248] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:40 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:41.263166 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0f64aff0-29bd-48ee-a681-d35ea0c14a4b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:41.265820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0f64aff0-29bd-48ee-a681-d35ea0c14a4b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:41.274522 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f64aff0-29bd-48ee-a681-d35ea0c14a4b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:41.275339 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f64aff0-29bd-48ee-a681-d35ea0c14a4b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:41.276127 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f64aff0-29bd-48ee-a681-d35ea0c14a4b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:41.276582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f64aff0-29bd-48ee-a681-d35ea0c14a4b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:41.393101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0f64aff0-29bd-48ee-a681-d35ea0c14a4b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.136417 Jan 17 02:43:41.394208 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 605/1249] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:41 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:41.837596 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:41.838142 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:41.844863 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:41.845308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:41.846067 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:41.846493 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:41.981497 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:41.989803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:41.991340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:41.992513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e59716d2-5559-424f-afad-ebf75d6141ee tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.158955 Jan 17 02:43:41.993067 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 645/1250] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:41 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:42.411711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a8ad7098-1e50-451d-87b1-d41786776874 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:42.412741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a8ad7098-1e50-451d-87b1-d41786776874 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:42.421219 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8ad7098-1e50-451d-87b1-d41786776874 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:42.421667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8ad7098-1e50-451d-87b1-d41786776874 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:42.422446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8ad7098-1e50-451d-87b1-d41786776874 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:42.422884 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8ad7098-1e50-451d-87b1-d41786776874 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:42.517835 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a8ad7098-1e50-451d-87b1-d41786776874 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.110613 Jan 17 02:43:42.518815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 606/1251] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:42 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:43.010715 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:43.011343 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:43.017951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:43.018395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:43.019165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:43.019592 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:43.158537 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:43.166785 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:43.168285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:43.169439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-193cf14b-e718-440e-a202-7f59b7221a5d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.162502 Jan 17 02:43:43.169998 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 646/1252] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:43 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:43.537122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4cdcdd56-d268-48e5-a65a-24fb72fc024a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:43.538637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4cdcdd56-d268-48e5-a65a-24fb72fc024a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:43.550178 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4cdcdd56-d268-48e5-a65a-24fb72fc024a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:43.550644 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4cdcdd56-d268-48e5-a65a-24fb72fc024a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:43.551685 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4cdcdd56-d268-48e5-a65a-24fb72fc024a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:43.552034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4cdcdd56-d268-48e5-a65a-24fb72fc024a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:43.665633 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4cdcdd56-d268-48e5-a65a-24fb72fc024a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.134943 Jan 17 02:43:43.666678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 607/1253] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:43 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:44.191721 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:44.192643 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:44.203518 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:44.204346 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:44.205709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:44.206136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:44.335712 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:44.347210 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:44.348743 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:44.349893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-61866d3a-58f1-44b5-8124-0abcd8187451 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.164661 Jan 17 02:43:44.350460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 647/1254] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:44 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:44.679663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-57428d3c-4819-44d6-bf8e-75e7aebead0e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:44.680690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-57428d3c-4819-44d6-bf8e-75e7aebead0e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:44.688108 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57428d3c-4819-44d6-bf8e-75e7aebead0e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:44.688590 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57428d3c-4819-44d6-bf8e-75e7aebead0e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:44.689395 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57428d3c-4819-44d6-bf8e-75e7aebead0e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:44.689928 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57428d3c-4819-44d6-bf8e-75e7aebead0e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:44.777678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-57428d3c-4819-44d6-bf8e-75e7aebead0e tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.101350 Jan 17 02:43:44.778599 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 608/1255] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:44 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:45.371735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:45.372768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:45.381340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:45.381787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:45.382563 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:45.382995 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:45.524118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:45.532533 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:45.534062 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:45.535199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-38c12f2c-a514-48f0-b30d-a07122dbf98f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.169940 Jan 17 02:43:45.535757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 648/1256] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:45 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:45.796806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a9bb2214-c5ad-4306-9b4e-163688cfe6c6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:45.798311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a9bb2214-c5ad-4306-9b4e-163688cfe6c6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:45.806273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9bb2214-c5ad-4306-9b4e-163688cfe6c6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:45.806744 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9bb2214-c5ad-4306-9b4e-163688cfe6c6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:45.807558 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9bb2214-c5ad-4306-9b4e-163688cfe6c6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:45.808011 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9bb2214-c5ad-4306-9b4e-163688cfe6c6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:45.896212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a9bb2214-c5ad-4306-9b4e-163688cfe6c6 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.106127 Jan 17 02:43:45.896864 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 609/1257] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:45 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:46.558017 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:46.558858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:46.569690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:46.570432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:46.571700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:46.572457 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:46.716561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:46.725118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:46.726602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:46.727758 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5df9478e-a36c-4ea6-820c-a26430d9f56b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.176155 Jan 17 02:43:46.728349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 649/1258] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:46 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:46.912128 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-27810376-ddbf-49fd-9d9e-2236afbbead9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:46.913370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-27810376-ddbf-49fd-9d9e-2236afbbead9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:46.921832 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27810376-ddbf-49fd-9d9e-2236afbbead9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:46.922366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27810376-ddbf-49fd-9d9e-2236afbbead9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:46.923290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27810376-ddbf-49fd-9d9e-2236afbbead9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:46.923804 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27810376-ddbf-49fd-9d9e-2236afbbead9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:47.012911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-27810376-ddbf-49fd-9d9e-2236afbbead9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.105847 Jan 17 02:43:47.013954 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 610/1259] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:46 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:47.751970 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:47.752609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:47.759506 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:47.759964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:47.760781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:47.761217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:47.897692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:47.906341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:47.907824 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:47.909007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d5db5b32-35cb-48f9-a6e8-9f962bb5c164 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.160802 Jan 17 02:43:47.909564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 650/1260] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:47 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:48.032212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-447403c6-930c-499d-805d-266bdfaefce4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:48.033860 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-447403c6-930c-499d-805d-266bdfaefce4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:48.045267 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-447403c6-930c-499d-805d-266bdfaefce4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:48.046039 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-447403c6-930c-499d-805d-266bdfaefce4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:48.047320 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-447403c6-930c-499d-805d-266bdfaefce4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:48.048035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-447403c6-930c-499d-805d-266bdfaefce4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:48.134190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-447403c6-930c-499d-805d-266bdfaefce4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.108787 Jan 17 02:43:48.135690 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 611/1261] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:48 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:48.928920 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:48.932650 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:48.939232 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:48.939974 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:48.940797 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:48.941235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:49.074874 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:49.086690 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:49.088709 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:49.089864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7987213a-9190-4083-bd30-f34c1932e909 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1746 microversion: 2.20 time: 0.166535 Jan 17 02:43:49.090736 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 651/1262] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:48 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:49.153048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d4119afb-0ec3-413e-a184-7622fb87b966 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:49.154628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d4119afb-0ec3-413e-a184-7622fb87b966 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:49.163434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4119afb-0ec3-413e-a184-7622fb87b966 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:49.163885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4119afb-0ec3-413e-a184-7622fb87b966 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:49.164700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4119afb-0ec3-413e-a184-7622fb87b966 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:49.165137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d4119afb-0ec3-413e-a184-7622fb87b966 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:49.261580 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d4119afb-0ec3-413e-a184-7622fb87b966 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.115292 Jan 17 02:43:49.262636 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 612/1263] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:49 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:50.112630 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:50.113301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:50.121462 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:50.122035 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:50.123007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:50.123553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:50.263517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:50.271971 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:50.273479 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:50.275015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a0191dec-bdd6-4494-9749-6c5ac85a87ba tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1746 microversion: 2.20 time: 0.168514 Jan 17 02:43:50.275563 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 652/1264] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:50 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:50.277199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-94dbefd7-93ea-4f49-a9e3-4cc1cc36ec57 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:50.278235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-94dbefd7-93ea-4f49-a9e3-4cc1cc36ec57 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:50.285394 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-94dbefd7-93ea-4f49-a9e3-4cc1cc36ec57 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:50.285845 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-94dbefd7-93ea-4f49-a9e3-4cc1cc36ec57 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:50.286630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-94dbefd7-93ea-4f49-a9e3-4cc1cc36ec57 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:50.287064 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-94dbefd7-93ea-4f49-a9e3-4cc1cc36ec57 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:50.385248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-94dbefd7-93ea-4f49-a9e3-4cc1cc36ec57 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.112323 Jan 17 02:43:50.385894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 613/1265] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:50 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:43:51.292468 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:51.293109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:51.299402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:51.299834 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:51.300635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:51.301062 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:51.397683 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b41f30a2-e65c-4087-a824-69b68c2d83d9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:51.398699 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b41f30a2-e65c-4087-a824-69b68c2d83d9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:51.406117 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b41f30a2-e65c-4087-a824-69b68c2d83d9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:51.406567 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b41f30a2-e65c-4087-a824-69b68c2d83d9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:51.407370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b41f30a2-e65c-4087-a824-69b68c2d83d9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:51.407808 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b41f30a2-e65c-4087-a824-69b68c2d83d9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:51.437545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:51.445570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:51.447033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:51.448209 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-52bec747-4881-4faa-954a-138f726ae14a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1746 microversion: 2.20 time: 0.159424 Jan 17 02:43:51.448761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 653/1266] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:51 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:51.525119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b41f30a2-e65c-4087-a824-69b68c2d83d9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.131006 Jan 17 02:43:51.525781 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 614/1267] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:51 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:52.470423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:52.471421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:52.482271 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:52.483020 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:52.484371 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:52.485100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:52.537024 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-2b7e37df-d69b-421a-a8a6-b5d6850a9586 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:52.537934 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-2b7e37df-d69b-421a-a8a6-b5d6850a9586 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:52.546081 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b7e37df-d69b-421a-a8a6-b5d6850a9586 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:52.546539 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b7e37df-d69b-421a-a8a6-b5d6850a9586 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:52.547521 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b7e37df-d69b-421a-a8a6-b5d6850a9586 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:52.548101 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-2b7e37df-d69b-421a-a8a6-b5d6850a9586 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:52.617664 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:52.625991 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:52.627475 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:52.628751 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cf587cd6-9461-4910-ba76-0f2fe665296f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1746 microversion: 2.20 time: 0.164644 Jan 17 02:43:52.629290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 654/1268] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:52 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:52.634176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2b7e37df-d69b-421a-a8a6-b5d6850a9586 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.101162 Jan 17 02:43:52.635630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 615/1269] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:52 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:53.088877 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-f349998a-8bed-41f0-8575-a047a9037c80 req-7fb0a6a5-fb53-4724-b17e-4754d391d3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834bc0c3-4bde-484a-8d9b-aab060aac09b", "name": "network-vif-plugged", "status": "completed", "tag": "8e033a10-4ded-4f31-af25-ef0b393110ad"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:53.090532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:43:53.090532 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:43:53.097951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-f349998a-8bed-41f0-8575-a047a9037c80 req-7fb0a6a5-fb53-4724-b17e-4754d391d3b1 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:53.098402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-f349998a-8bed-41f0-8575-a047a9037c80 req-7fb0a6a5-fb53-4724-b17e-4754d391d3b1 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:53.109819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-f349998a-8bed-41f0-8575-a047a9037c80 req-7fb0a6a5-fb53-4724-b17e-4754d391d3b1 service nova] Creating event network-vif-plugged:8e033a10-4ded-4f31-af25-ef0b393110ad for instance 834bc0c3-4bde-484a-8d9b-aab060aac09b on hv-cinder-82160 Jan 17 02:43:53.114889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-f349998a-8bed-41f0-8575-a047a9037c80 req-7fb0a6a5-fb53-4724-b17e-4754d391d3b1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029740 Jan 17 02:43:53.115463 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 655/1270] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:43:53.651494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-970e740d-4a28-48a2-8e84-d5381b352d8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:53.653137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-970e740d-4a28-48a2-8e84-d5381b352d8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:53.653603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:53.654728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:53.662837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-970e740d-4a28-48a2-8e84-d5381b352d8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:53.663011 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:53.663280 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-970e740d-4a28-48a2-8e84-d5381b352d8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:53.663426 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:53.664057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-970e740d-4a28-48a2-8e84-d5381b352d8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:53.664224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:53.664521 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-970e740d-4a28-48a2-8e84-d5381b352d8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:53.664691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:53.754945 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-970e740d-4a28-48a2-8e84-d5381b352d8b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.110439 Jan 17 02:43:53.755820 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 616/1271] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:53 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:53.800047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:53.807901 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:53.809423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:53.810575 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-89eba4f9-cb2e-4eca-8c36-45f0999a9549 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1746 microversion: 2.20 time: 0.164859 Jan 17 02:43:53.811133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 656/1272] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:53 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:54.767976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d0b6dc51-2656-4765-9aa9-c3d086d5c9b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:54.769121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d0b6dc51-2656-4765-9aa9-c3d086d5c9b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:54.777226 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0b6dc51-2656-4765-9aa9-c3d086d5c9b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:54.777680 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0b6dc51-2656-4765-9aa9-c3d086d5c9b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:54.778474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0b6dc51-2656-4765-9aa9-c3d086d5c9b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:54.778907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0b6dc51-2656-4765-9aa9-c3d086d5c9b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:54.828900 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:54.829451 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:54.836328 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:54.836782 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:54.837559 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:54.837997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:54.875376 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d0b6dc51-2656-4765-9aa9-c3d086d5c9b9 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.111783 Jan 17 02:43:54.876005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 617/1273] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:54 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:54.977693 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:54.990184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:54.992695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:54.994446 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6d43177f-c9fc-4209-b96e-bb4fb5400111 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1746 microversion: 2.20 time: 0.168988 Jan 17 02:43:54.995218 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 657/1274] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:54 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:55.892205 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d489848c-0c3b-46dc-8c1f-215f0a887d2b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:55.894593 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d489848c-0c3b-46dc-8c1f-215f0a887d2b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:55.906772 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d489848c-0c3b-46dc-8c1f-215f0a887d2b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:55.907533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d489848c-0c3b-46dc-8c1f-215f0a887d2b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:55.908891 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d489848c-0c3b-46dc-8c1f-215f0a887d2b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:55.909604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d489848c-0c3b-46dc-8c1f-215f0a887d2b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:56.009290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d489848c-0c3b-46dc-8c1f-215f0a887d2b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.123909 Jan 17 02:43:56.012935 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 618/1275] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:55 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:56.016485 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:56.017078 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:56.023855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:56.024694 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:56.025465 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:56.025893 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:56.160229 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:56.168216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:56.169689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:56.170837 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5cab68c0-14d9-4a2a-aa37-41f99c06de7b tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.158659 Jan 17 02:43:56.171384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 658/1276] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:56 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:43:57.026360 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-014b373b-9011-4468-ad62-6a7be9f5d261 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:57.028322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-014b373b-9011-4468-ad62-6a7be9f5d261 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:57.035556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014b373b-9011-4468-ad62-6a7be9f5d261 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:57.038733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014b373b-9011-4468-ad62-6a7be9f5d261 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:57.039742 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014b373b-9011-4468-ad62-6a7be9f5d261 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:57.040422 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-014b373b-9011-4468-ad62-6a7be9f5d261 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:57.135624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-014b373b-9011-4468-ad62-6a7be9f5d261 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.114121 Jan 17 02:43:57.140093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 619/1277] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:57 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:57.189885 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:57.190618 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:57.198651 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:57.199187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:57.200053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:57.200583 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:57.337835 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:57.345902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:57.347714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:57.349200 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8cd716b5-36f4-4287-a183-56af57c9484f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.163418 Jan 17 02:43:57.349993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 659/1278] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:57 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:58.147609 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5306ce7f-a3ec-4732-8696-10628c8a2696 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:58.149164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5306ce7f-a3ec-4732-8696-10628c8a2696 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:58.156949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5306ce7f-a3ec-4732-8696-10628c8a2696 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:58.157661 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5306ce7f-a3ec-4732-8696-10628c8a2696 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:58.158948 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5306ce7f-a3ec-4732-8696-10628c8a2696 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:58.159459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5306ce7f-a3ec-4732-8696-10628c8a2696 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:58.250800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5306ce7f-a3ec-4732-8696-10628c8a2696 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.106895 Jan 17 02:43:58.255723 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 620/1279] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:58 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:58.368043 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:58.369348 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:58.375978 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:58.376472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:58.377244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:58.377702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:58.512956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:58.521441 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:58.523224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:58.524853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1a7ebb0f-e069-4f75-87dc-ad2dc7d74daf tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.160345 Jan 17 02:43:58.525498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 660/1280] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:58 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:43:59.270330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bbc9d42c-8e4c-43d9-8c84-e2efe77c9cb3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:43:59.270330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bbc9d42c-8e4c-43d9-8c84-e2efe77c9cb3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:59.278038 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bbc9d42c-8e4c-43d9-8c84-e2efe77c9cb3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:59.278492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bbc9d42c-8e4c-43d9-8c84-e2efe77c9cb3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:59.279299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bbc9d42c-8e4c-43d9-8c84-e2efe77c9cb3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:59.279738 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bbc9d42c-8e4c-43d9-8c84-e2efe77c9cb3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:59.370727 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bbc9d42c-8e4c-43d9-8c84-e2efe77c9cb3 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.109076 Jan 17 02:43:59.374618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 621/1281] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:43:59 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:43:59.543419 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:43:59.544182 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:43:59.551526 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:59.552244 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:59.553044 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:43:59.553490 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:43:59.694902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:59.703875 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:59.705494 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:43:59.706886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-871bc306-8ec0-4742-9056-314c9cf024a6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.167466 Jan 17 02:43:59.718470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 661/1282] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:43:59 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:00.382741 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d50a3c63-c075-4b12-9ad2-8ddab6b63baf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:00.385324 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d50a3c63-c075-4b12-9ad2-8ddab6b63baf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:00.391825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d50a3c63-c075-4b12-9ad2-8ddab6b63baf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:00.392374 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d50a3c63-c075-4b12-9ad2-8ddab6b63baf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:00.393259 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d50a3c63-c075-4b12-9ad2-8ddab6b63baf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:00.394069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d50a3c63-c075-4b12-9ad2-8ddab6b63baf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:00.483920 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d50a3c63-c075-4b12-9ad2-8ddab6b63baf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.105075 Jan 17 02:44:00.484969 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 622/1283] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:00 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:00.724692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:00.725296 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:00.735013 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:00.735520 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:00.736301 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:00.736757 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:00.872033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:00.881591 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:00.882112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:00.883363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3188a3d1-84eb-4c7e-a2d1-41d424495966 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.162461 Jan 17 02:44:00.884029 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 662/1284] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:00 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:01.496802 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bfc1c0c7-1005-442e-b45f-499ca7f27fe2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:01.497733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bfc1c0c7-1005-442e-b45f-499ca7f27fe2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:01.505087 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc1c0c7-1005-442e-b45f-499ca7f27fe2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:01.505540 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc1c0c7-1005-442e-b45f-499ca7f27fe2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:01.506333 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc1c0c7-1005-442e-b45f-499ca7f27fe2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:01.506774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfc1c0c7-1005-442e-b45f-499ca7f27fe2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:01.593798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bfc1c0c7-1005-442e-b45f-499ca7f27fe2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.100970 Jan 17 02:44:01.594685 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 623/1285] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:01 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:01.902654 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:01.903250 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:01.910285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:01.910740 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:01.911558 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:01.912001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:02.054864 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:02.062950 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:02.064454 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:02.065600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-40b6a394-158e-4040-86a2-3158ded294c6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.167768 Jan 17 02:44:02.076549 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 663/1286] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:01 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:02.606905 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-455ee274-50dc-422a-9793-beed52c4159b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:02.607843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-455ee274-50dc-422a-9793-beed52c4159b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:02.614997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-455ee274-50dc-422a-9793-beed52c4159b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:02.615446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-455ee274-50dc-422a-9793-beed52c4159b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:02.616284 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-455ee274-50dc-422a-9793-beed52c4159b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:02.616791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-455ee274-50dc-422a-9793-beed52c4159b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:02.704900 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-455ee274-50dc-422a-9793-beed52c4159b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.101927 Jan 17 02:44:02.705763 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 624/1287] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:02 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:03.084300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:03.085744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:03.092614 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:03.093305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:03.094098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:03.094687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:03.229850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:03.238796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:03.239840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:03.241070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6056cde5-8ac4-4c5e-a21f-8e385faf49d4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.160635 Jan 17 02:44:03.249568 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 664/1288] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:03 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:03.721677 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-aa069213-23e2-4431-8e94-5170c5657fcc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:03.722693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-aa069213-23e2-4431-8e94-5170c5657fcc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:03.733132 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa069213-23e2-4431-8e94-5170c5657fcc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:03.733650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa069213-23e2-4431-8e94-5170c5657fcc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:03.734502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa069213-23e2-4431-8e94-5170c5657fcc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:03.734932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-aa069213-23e2-4431-8e94-5170c5657fcc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:03.846725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-aa069213-23e2-4431-8e94-5170c5657fcc tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.129308 Jan 17 02:44:03.848901 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 625/1289] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:03 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:04.259070 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:04.260327 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:04.269808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:04.270599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:04.271399 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:04.271838 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:04.413700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:04.423870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:04.426129 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:04.427309 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ca7d24d9-4dce-47be-9e8b-9e3487f06a99 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.172381 Jan 17 02:44:04.428488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 665/1290] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:04 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:04.860158 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a0eba192-ba31-49e0-982b-778f665723e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:04.861209 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a0eba192-ba31-49e0-982b-778f665723e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:04.869069 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eba192-ba31-49e0-982b-778f665723e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:04.869519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eba192-ba31-49e0-982b-778f665723e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:04.870532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eba192-ba31-49e0-982b-778f665723e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:04.870972 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a0eba192-ba31-49e0-982b-778f665723e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:04.981068 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a0eba192-ba31-49e0-982b-778f665723e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.125157 Jan 17 02:44:04.982054 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 626/1291] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:04 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:05.449032 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:05.450635 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:05.457917 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:05.458632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:05.459680 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:05.460217 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:05.598500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:05.606428 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:05.607931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:05.609114 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7fa4bb09-e964-4c0a-a5b6-3d0437e74dc7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.164094 Jan 17 02:44:05.609675 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 666/1292] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:05 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:05.998851 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9b28cdc3-db78-4f7c-a59c-35dfbf2b9c92 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:06.000530 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9b28cdc3-db78-4f7c-a59c-35dfbf2b9c92 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:06.012196 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9b28cdc3-db78-4f7c-a59c-35dfbf2b9c92 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:06.012979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9b28cdc3-db78-4f7c-a59c-35dfbf2b9c92 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:06.014274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9b28cdc3-db78-4f7c-a59c-35dfbf2b9c92 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:06.014998 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9b28cdc3-db78-4f7c-a59c-35dfbf2b9c92 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:06.249721 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9b28cdc3-db78-4f7c-a59c-35dfbf2b9c92 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.256251 Jan 17 02:44:06.249943 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 627/1293] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:05 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:06.630759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:06.631716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:06.642430 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:06.643174 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:06.644531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:06.644964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:06.774563 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:06.782817 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:06.784370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:06.785551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-cf7a51f9-e6d4-4eca-b448-8520d3f666ab tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1741 microversion: 2.20 time: 0.161147 Jan 17 02:44:06.786112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 667/1294] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:06 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:07.264532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-cc998ce1-0206-4146-8c2b-791b13f67daf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:07.265550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-cc998ce1-0206-4146-8c2b-791b13f67daf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:07.272977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc998ce1-0206-4146-8c2b-791b13f67daf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:07.273434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc998ce1-0206-4146-8c2b-791b13f67daf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:07.274589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc998ce1-0206-4146-8c2b-791b13f67daf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:07.275027 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-cc998ce1-0206-4146-8c2b-791b13f67daf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:07.362306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-cc998ce1-0206-4146-8c2b-791b13f67daf tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.102638 Jan 17 02:44:07.363242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 628/1295] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:07 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:07.804207 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:07.804792 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:07.811311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:07.811755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:07.812602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:07.813059 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:07.949641 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:07.957717 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:07.959216 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:07.960409 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f1148d6b-2069-42c5-8e4d-a90ae5bbb041 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1723 microversion: 2.20 time: 0.160059 Jan 17 02:44:07.960985 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 668/1296] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:07 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:08.379089 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a3d80193-956d-46ea-abe7-ff32ba53404a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:08.380344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a3d80193-956d-46ea-abe7-ff32ba53404a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:08.388957 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3d80193-956d-46ea-abe7-ff32ba53404a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:08.389489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3d80193-956d-46ea-abe7-ff32ba53404a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:08.390451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3d80193-956d-46ea-abe7-ff32ba53404a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:08.390964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a3d80193-956d-46ea-abe7-ff32ba53404a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:08.487169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a3d80193-956d-46ea-abe7-ff32ba53404a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.114803 Jan 17 02:44:08.487813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 629/1297] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:08 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:08.982857 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:08.983738 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:08.992121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:08.992603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:08.993372 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:08.993807 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:09.127933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:09.136048 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:09.137563 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:09.138718 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ddee0b75-c374-4653-a633-e8dc37795e45 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1723 microversion: 2.20 time: 0.162262 Jan 17 02:44:09.139277 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 669/1298] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:08 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:09.499825 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-463d6303-27e9-497b-94d3-5dfcaa6a4c58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:09.500791 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-463d6303-27e9-497b-94d3-5dfcaa6a4c58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:09.509629 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-463d6303-27e9-497b-94d3-5dfcaa6a4c58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:09.510290 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-463d6303-27e9-497b-94d3-5dfcaa6a4c58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:09.511493 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-463d6303-27e9-497b-94d3-5dfcaa6a4c58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:09.511996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-463d6303-27e9-497b-94d3-5dfcaa6a4c58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:09.599043 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-463d6303-27e9-497b-94d3-5dfcaa6a4c58 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.103082 Jan 17 02:44:09.599692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 630/1299] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:09 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:10.161553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:10.162438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:10.173282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.174043 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:10.175338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.176102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:10.311770 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:10.319742 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:10.321277 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:10.322439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-241bf2d3-fea9-4018-86c6-f3c1d5c515b9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1666 microversion: 2.20 time: 0.167339 Jan 17 02:44:10.323006 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 670/1300] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:10 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:10.341019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-92b89eab-e13a-4fa2-bc37-e289cdedd007 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff8f3a2-a08a-44bc-95a5-d4f1602e889a"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:10.342189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-92b89eab-e13a-4fa2-bc37-e289cdedd007 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:10.349592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-92b89eab-e13a-4fa2-bc37-e289cdedd007 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.350175 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-92b89eab-e13a-4fa2-bc37-e289cdedd007 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:10.350968 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-92b89eab-e13a-4fa2-bc37-e289cdedd007 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.351408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-92b89eab-e13a-4fa2-bc37-e289cdedd007 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:10.610910 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e91020ff-1f63-4ff0-b467-8622307249c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:10.611832 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e91020ff-1f63-4ff0-b467-8622307249c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:10.618100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e91020ff-1f63-4ff0-b467-8622307249c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.618495 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e91020ff-1f63-4ff0-b467-8622307249c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:10.619275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e91020ff-1f63-4ff0-b467-8622307249c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.619707 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e91020ff-1f63-4ff0-b467-8622307249c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:10.634634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-92b89eab-e13a-4fa2-bc37-e289cdedd007 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297919 Jan 17 02:44:10.635870 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 631/1301] 10.222.0.24 () {62 vars in 1363 bytes} [Mon Jan 17 02:44:10 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 02:44:10.703484 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e91020ff-1f63-4ff0-b467-8622307249c0 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 28645 microversion: 2.1 time: 0.095900 Jan 17 02:44:10.704370 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 671/1302] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:10 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 28645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:10.756654 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-12dca918-d906-43a2-aebc-05d1891745be tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:10.757142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-12dca918-d906-43a2-aebc-05d1891745be tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:10.763456 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12dca918-d906-43a2-aebc-05d1891745be tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.763885 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12dca918-d906-43a2-aebc-05d1891745be tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:10.764703 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12dca918-d906-43a2-aebc-05d1891745be tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:10.765130 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-12dca918-d906-43a2-aebc-05d1891745be tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:11.014007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-12dca918-d906-43a2-aebc-05d1891745be tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-volume_attachments/4ff8f3a2-a08a-44bc-95a5-d4f1602e889a" status: 202 len: 0 microversion: 2.20 time: 0.261164 Jan 17 02:44:11.014667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 632/1303] 10.222.0.24 () {60 vars in 1456 bytes} [Mon Jan 17 02:44:10 2022] DELETE /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-volume_attachments/4ff8f3a2-a08a-44bc-95a5-d4f1602e889a => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:44:11.071789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:11.072588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:11.081421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:11.081878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:11.082667 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:11.083104 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:11.160082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-686fc5f1-0ead-4314-a744-d0d1bae0378f req-b9e65345-c7b0-4990-ac1f-5ef65a7ccdee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834bc0c3-4bde-484a-8d9b-aab060aac09b", "name": "network-vif-unplugged", "status": "completed", "tag": "8e033a10-4ded-4f31-af25-ef0b393110ad"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:11.162242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:44:11.162242 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:44:11.169616 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: ERROR oslo.messaging._drivers.impl_rabbit [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [7b42998f-0266-4e55-bbb2-f7c69b38b3b3] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:44:11.171981 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-686fc5f1-0ead-4314-a744-d0d1bae0378f req-b9e65345-c7b0-4990-ac1f-5ef65a7ccdee service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:11.172585 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-686fc5f1-0ead-4314-a744-d0d1bae0378f req-b9e65345-c7b0-4990-ac1f-5ef65a7ccdee service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:11.184526 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.compute.server_external_events [req-686fc5f1-0ead-4314-a744-d0d1bae0378f req-b9e65345-c7b0-4990-ac1f-5ef65a7ccdee service nova] Unable to find a host for instance 834bc0c3-4bde-484a-8d9b-aab060aac09b. Dropping event network-vif-unplugged {{(pid=122782) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 17 02:44:11.185420 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-686fc5f1-0ead-4314-a744-d0d1bae0378f req-b9e65345-c7b0-4990-ac1f-5ef65a7ccdee service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030280 Jan 17 02:44:11.186021 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 633/1304] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 17 02:44:11.717616 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7fd02c88-bfee-4c1e-bd95-990337326b96 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:11.718568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7fd02c88-bfee-4c1e-bd95-990337326b96 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:11.725267 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7fd02c88-bfee-4c1e-bd95-990337326b96 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:11.725710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7fd02c88-bfee-4c1e-bd95-990337326b96 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:11.726487 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7fd02c88-bfee-4c1e-bd95-990337326b96 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:11.726916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7fd02c88-bfee-4c1e-bd95-990337326b96 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:11.826753 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7fd02c88-bfee-4c1e-bd95-990337326b96 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 30366 microversion: 2.1 time: 0.112308 Jan 17 02:44:11.827967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 634/1305] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:11 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 30366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:12.181725 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [7b42998f-0266-4e55-bbb2-f7c69b38b3b3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 50570. Jan 17 02:44:12.187599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-53e55d2c-8e0f-48ec-aa47-4bc700d2ff8d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action" status: 202 len: 0 microversion: 2.20 time: 1.121161 Jan 17 02:44:12.188599 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 672/1306] 10.222.0.24 () {62 vars in 1318 bytes} [Mon Jan 17 02:44:11 2022] POST /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/action => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:44:12.199324 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:12.200017 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:12.206771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:12.207254 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:12.208037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:12.208502 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:12.342256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:12.350508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:12.352154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:12.353448 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d5db0c03-d031-41dd-ad8f-8ce4cc9bb8a9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1674 microversion: 2.20 time: 0.158333 Jan 17 02:44:12.354085 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 635/1307] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:12 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:44:12.841570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-93666e6f-b45d-44cc-9b83-e4ed11f4e217 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:12.842415 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-93666e6f-b45d-44cc-9b83-e4ed11f4e217 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:12.849762 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93666e6f-b45d-44cc-9b83-e4ed11f4e217 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:12.850305 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93666e6f-b45d-44cc-9b83-e4ed11f4e217 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:12.851094 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93666e6f-b45d-44cc-9b83-e4ed11f4e217 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:12.851528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-93666e6f-b45d-44cc-9b83-e4ed11f4e217 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:12.987878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-93666e6f-b45d-44cc-9b83-e4ed11f4e217 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 32348 microversion: 2.1 time: 0.150168 Jan 17 02:44:12.988586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 673/1308] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:12 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 32348 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:13.372508 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:13.373116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:13.379712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:13.380198 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:13.380973 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:13.381429 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:13.590750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:13.598620 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:13.600212 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:13.601374 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-81ef69bc-d226-4286-a797-c17fc1b842ff tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.232702 Jan 17 02:44:13.601978 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 636/1309] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:13 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:14.000509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a2cbc00d-addd-47da-bdeb-54f3b49578e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:14.001524 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a2cbc00d-addd-47da-bdeb-54f3b49578e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:14.008614 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2cbc00d-addd-47da-bdeb-54f3b49578e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:14.009074 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2cbc00d-addd-47da-bdeb-54f3b49578e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:14.009851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2cbc00d-addd-47da-bdeb-54f3b49578e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:14.010297 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a2cbc00d-addd-47da-bdeb-54f3b49578e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:14.108950 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a2cbc00d-addd-47da-bdeb-54f3b49578e2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 33496 microversion: 2.1 time: 0.112350 Jan 17 02:44:14.109573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 674/1310] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:13 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 33496 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:14.623836 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:14.624441 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:14.631494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:14.632015 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:14.633099 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:14.633375 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:14.769778 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:14.778400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:14.779878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:14.781076 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-60993b6e-86df-4648-aa33-f0da45cba48e tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.161148 Jan 17 02:44:14.781689 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 637/1311] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:14 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:15.122544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b91ab9c8-740b-425f-8719-125a68d3edbd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:15.123726 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b91ab9c8-740b-425f-8719-125a68d3edbd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:15.131252 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b91ab9c8-740b-425f-8719-125a68d3edbd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:15.131708 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b91ab9c8-740b-425f-8719-125a68d3edbd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:15.132541 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b91ab9c8-740b-425f-8719-125a68d3edbd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:15.132979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b91ab9c8-740b-425f-8719-125a68d3edbd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:15.800980 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:15.801572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:15.810150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:15.810600 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:15.811399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:15.811831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:15.960990 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:15.968788 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:15.970258 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:15.971401 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e14ea6c1-87df-435e-bc71-2bf5e538c3f6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.175814 Jan 17 02:44:15.971965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 638/1312] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:15 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:16.992504 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:16.993263 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:16.999751 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:17.000239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:17.001018 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:17.001451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:17.409952 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:17.418828 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:17.420215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:17.421797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5e5760df-ff37-4c71-973a-2646420ae447 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.433164 Jan 17 02:44:17.423929 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 639/1313] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:16 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:18.440437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:18.441137 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:18.447764 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:18.448250 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:18.449037 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:18.449476 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:18.585049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:18.592987 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:18.594486 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:18.595639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-792d5104-f9f1-4b2e-b4ff-7384fb700f34 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.159099 Jan 17 02:44:18.596248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 640/1314] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:18 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:19.618401 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:19.619192 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:19.626455 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:19.626907 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:19.627840 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:19.628308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:19.780285 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:19.788171 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:19.789976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:19.791145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7f6800af-7388-4b67-bba8-7b1b8148115f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.180674 Jan 17 02:44:19.791711 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 641/1315] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:19 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:44:20.810115 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:20.810925 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:20.817660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:20.818044 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:20.818831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:20.819292 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:20.957272 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:20.961755 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:20.963337 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:20.964837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-f93d276a-2e95-42fa-ac94-c5e9cd8809e7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.158438 Jan 17 02:44:20.965576 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 642/1316] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:20 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:44:21.044688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1476057176"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:21.045381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:21.052357 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:21.053147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:21.054078 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:21.054605 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:21.190006 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.network.security_group_api [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Removing security group 8671b338-c404-47bf-a75a-7688dab5fc46 from port 6165ac27-1cf4-4f9d-b4a0-390a637a75d1 Jan 17 02:44:21.590961 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b5bf275e-9207-439b-93b6-5679ce7beb19 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/action" status: 202 len: 0 microversion: 2.1 time: 0.550613 Jan 17 02:44:21.591897 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 643/1317] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:21 2022] POST /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:44:21.605722 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-66562422-6242-4dea-9056-9089b1d577de req-38455f26-6e83-44bf-8600-0f7c2e3f527e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e84400-8d07-4d52-a0af-fe7faf22466e", "tag": "6165ac27-1cf4-4f9d-b4a0-390a637a75d1"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:21.607305 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:44:21.607305 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:44:21.615680 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-66562422-6242-4dea-9056-9089b1d577de req-38455f26-6e83-44bf-8600-0f7c2e3f527e service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:21.616425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-66562422-6242-4dea-9056-9089b1d577de req-38455f26-6e83-44bf-8600-0f7c2e3f527e service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:21.631774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-66562422-6242-4dea-9056-9089b1d577de req-38455f26-6e83-44bf-8600-0f7c2e3f527e service nova] Creating event network-changed:6165ac27-1cf4-4f9d-b4a0-390a637a75d1 for instance 06e84400-8d07-4d52-a0af-fe7faf22466e on hv-cinder-82160 Jan 17 02:44:21.637368 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-66562422-6242-4dea-9056-9089b1d577de req-38455f26-6e83-44bf-8600-0f7c2e3f527e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035118 Jan 17 02:44:21.638533 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 644/1318] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:44:21.985763 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:21.987230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:21.995725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:21.996584 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:21.997763 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:21.998799 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:22.207761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:22.217260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:22.219658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:22.221092 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-792cc412-8f29-4e18-a5bb-906717996b47 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.239379 Jan 17 02:44:22.224261 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 645/1319] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:21 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:44:22.934301 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:22.934795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:22.940947 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:22.941475 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:22.942338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:22.942841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:23.030875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lazy-loading 'services' on Instance uuid 06e84400-8d07-4d52-a0af-fe7faf22466e {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:44:23.119161 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b86bad0a-8462-4ab0-a4c7-ae63f9c7a2bd tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "DELETE /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments/8db416b0-3017-4434-8868-45bcf6ae9490" status: 202 len: 0 microversion: 2.1 time: 0.188677 Jan 17 02:44:23.119801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 646/1320] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:44:22 2022] DELETE /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments/8db416b0-3017-4434-8868-45bcf6ae9490 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 02:44:23.131650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3f09ad37-ae60-4b35-b41f-6bb23da7e3df tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:23.131650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3f09ad37-ae60-4b35-b41f-6bb23da7e3df tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:23.136872 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f09ad37-ae60-4b35-b41f-6bb23da7e3df tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:23.137402 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f09ad37-ae60-4b35-b41f-6bb23da7e3df tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:23.138266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f09ad37-ae60-4b35-b41f-6bb23da7e3df tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:23.138806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3f09ad37-ae60-4b35-b41f-6bb23da7e3df tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:23.185970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3f09ad37-ae60-4b35-b41f-6bb23da7e3df tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061503 Jan 17 02:44:23.186537 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 647/1321] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:23 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:44:23.241010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:23.241800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:23.248371 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:23.248821 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:23.249622 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:23.250061 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:23.403737 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:23.411613 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:23.413194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:23.414406 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3744ff1a-24a5-4537-9da0-804353db5614 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.177159 Jan 17 02:44:23.414982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 648/1322] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:23 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 02:44:23.652817 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-5588edb6-9f3a-439b-b49a-f36f1942ad58 req-eb35347b-8f43-4859-9575-6e7dea0dbfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e84400-8d07-4d52-a0af-fe7faf22466e", "tag": "6165ac27-1cf4-4f9d-b4a0-390a637a75d1"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:23.654340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:44:23.654340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:44:23.663266 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-5588edb6-9f3a-439b-b49a-f36f1942ad58 req-eb35347b-8f43-4859-9575-6e7dea0dbfd8 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:23.663710 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-5588edb6-9f3a-439b-b49a-f36f1942ad58 req-eb35347b-8f43-4859-9575-6e7dea0dbfd8 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:23.675262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-5588edb6-9f3a-439b-b49a-f36f1942ad58 req-eb35347b-8f43-4859-9575-6e7dea0dbfd8 service nova] Creating event network-changed:6165ac27-1cf4-4f9d-b4a0-390a637a75d1 for instance 06e84400-8d07-4d52-a0af-fe7faf22466e on hv-cinder-82160 Jan 17 02:44:23.683277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-5588edb6-9f3a-439b-b49a-f36f1942ad58 req-eb35347b-8f43-4859-9575-6e7dea0dbfd8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033038 Jan 17 02:44:23.683277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 649/1323] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:44:24.199740 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a8266517-2416-4c0f-a6f3-ed4e542aa71d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:24.200782 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a8266517-2416-4c0f-a6f3-ed4e542aa71d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:24.207976 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8266517-2416-4c0f-a6f3-ed4e542aa71d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:24.208434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8266517-2416-4c0f-a6f3-ed4e542aa71d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:24.209230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8266517-2416-4c0f-a6f3-ed4e542aa71d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:24.209665 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a8266517-2416-4c0f-a6f3-ed4e542aa71d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:24.239798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a8266517-2416-4c0f-a6f3-ed4e542aa71d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Jan 17 02:44:24.240394 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 650/1324] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:24 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:24.434457 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:24.434989 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:24.441465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:24.441933 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:24.442683 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:24.443111 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:24.585320 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:24.593832 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:24.595303 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:24.596481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-73f63069-e406-4691-9ae5-4b69ede32ceb tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.166855 Jan 17 02:44:24.597044 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 651/1325] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:24 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:25.252866 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-51527e9c-5ea8-40d3-b4fc-921cf22f89b2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:25.254067 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-51527e9c-5ea8-40d3-b4fc-921cf22f89b2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:25.262913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-51527e9c-5ea8-40d3-b4fc-921cf22f89b2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:25.263518 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-51527e9c-5ea8-40d3-b4fc-921cf22f89b2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:25.264601 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-51527e9c-5ea8-40d3-b4fc-921cf22f89b2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:25.265189 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-51527e9c-5ea8-40d3-b4fc-921cf22f89b2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:25.296713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-51527e9c-5ea8-40d3-b4fc-921cf22f89b2 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049004 Jan 17 02:44:25.297260 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 652/1326] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:25 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:25.618330 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:25.619247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:25.629434 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:25.630168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:25.631472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:25.632140 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:25.775066 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:25.783800 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:25.785335 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:25.786492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0aec237a-1888-4d48-ae6c-a351e9a0b34a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.174614 Jan 17 02:44:25.787079 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 653/1327] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:25 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:26.309836 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7ca4869e-4a5f-413d-91f5-3a80948aa362 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:26.310926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7ca4869e-4a5f-413d-91f5-3a80948aa362 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:26.319007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ca4869e-4a5f-413d-91f5-3a80948aa362 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:26.319532 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ca4869e-4a5f-413d-91f5-3a80948aa362 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:26.320495 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ca4869e-4a5f-413d-91f5-3a80948aa362 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:26.321007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ca4869e-4a5f-413d-91f5-3a80948aa362 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:26.351248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7ca4869e-4a5f-413d-91f5-3a80948aa362 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Jan 17 02:44:26.351787 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 654/1328] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:26 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:26.807215 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:26.808160 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:26.816314 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:26.816771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:26.817586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:26.820377 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:26.890750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b91ab9c8-740b-425f-8719-125a68d3edbd tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action" status: 200 len: 38304 microversion: 2.1 time: 11.772179 Jan 17 02:44:26.891486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 675/1329] 10.222.0.24 () {60 vars in 1277 bytes} [Mon Jan 17 02:44:15 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/action => generated 38304 bytes in 11775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 02:44:26.902552 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-862f2d27-35e1-4121-b591-837f987d3901 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:26.903200 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-862f2d27-35e1-4121-b591-837f987d3901 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:26.910177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-862f2d27-35e1-4121-b591-837f987d3901 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:26.910726 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-862f2d27-35e1-4121-b591-837f987d3901 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:26.911568 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-862f2d27-35e1-4121-b591-837f987d3901 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:26.911997 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-862f2d27-35e1-4121-b591-837f987d3901 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:26.936895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-862f2d27-35e1-4121-b591-837f987d3901 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/ips" status: 200 len: 146 microversion: 2.1 time: 0.037996 Jan 17 02:44:26.936895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 676/1330] 10.222.0.24 () {58 vars in 1247 bytes} [Mon Jan 17 02:44:26 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:44:27.040398 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:27.048408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:27.049887 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:27.051054 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-97427d9f-46d7-46fd-ba9c-5354611cdcf1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.249191 Jan 17 02:44:27.051592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 655/1331] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:26 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:27.362928 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-425a610a-db94-463e-99ab-2e2ecb2be46b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:27.363944 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-425a610a-db94-463e-99ab-2e2ecb2be46b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:27.370728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-425a610a-db94-463e-99ab-2e2ecb2be46b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:27.371179 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-425a610a-db94-463e-99ab-2e2ecb2be46b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:27.371968 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-425a610a-db94-463e-99ab-2e2ecb2be46b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:27.372449 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-425a610a-db94-463e-99ab-2e2ecb2be46b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:27.402910 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-425a610a-db94-463e-99ab-2e2ecb2be46b tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Jan 17 02:44:27.407028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 677/1332] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:27 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:28.070964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:28.071598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:28.078555 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.079012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.079798 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.080270 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.211318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:28.220771 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:28.222631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:28.223930 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8449a3f6-72a4-402e-930d-060057b86f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.157320 Jan 17 02:44:28.224746 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 656/1333] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:28 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:28.251775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8a66f91c-189c-4c94-984c-7a13deb17f33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "206908b2-2366-478f-aaf1-cea4a0bf88b0"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:28.252855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8a66f91c-189c-4c94-984c-7a13deb17f33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:28.259083 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a66f91c-189c-4c94-984c-7a13deb17f33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.259531 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a66f91c-189c-4c94-984c-7a13deb17f33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.260342 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a66f91c-189c-4c94-984c-7a13deb17f33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.260774 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8a66f91c-189c-4c94-984c-7a13deb17f33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.415706 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d0d72dd7-5c8b-447b-8823-302429187ef6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:28.416644 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d0d72dd7-5c8b-447b-8823-302429187ef6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:28.422877 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0d72dd7-5c8b-447b-8823-302429187ef6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.423322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0d72dd7-5c8b-447b-8823-302429187ef6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.424130 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0d72dd7-5c8b-447b-8823-302429187ef6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.424571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d0d72dd7-5c8b-447b-8823-302429187ef6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.452905 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d0d72dd7-5c8b-447b-8823-302429187ef6 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041491 Jan 17 02:44:28.453650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 657/1334] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:28 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:44:28.463358 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:28.463932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:28.470002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.470617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.472274 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:28.472795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:28.528349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8a66f91c-189c-4c94-984c-7a13deb17f33 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280117 Jan 17 02:44:28.529036 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 678/1335] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:44:28 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:28.556247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] HTTP exception thrown: Instance 06e84400-8d07-4d52-a0af-fe7faf22466e is not attached to volume 8db416b0-3017-4434-8868-45bcf6ae9490 Jan 17 02:44:28.556982 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Returning 404 to user: Instance 06e84400-8d07-4d52-a0af-fe7faf22466e is not attached to volume 8db416b0-3017-4434-8868-45bcf6ae9490 {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:44:28.557869 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3d17ed1e-052f-4953-aed9-eb0a5663b79d tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "DELETE /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments/8db416b0-3017-4434-8868-45bcf6ae9490" status: 404 len: 154 microversion: 2.1 time: 0.098490 Jan 17 02:44:28.558418 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 658/1336] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:44:28 2022] DELETE /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e/os-volume_attachments/8db416b0-3017-4434-8868-45bcf6ae9490 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 02:44:29.244445 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:29.245168 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:29.253925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:29.254456 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:29.255145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:29.255573 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:29.435755 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:29.443772 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:29.445296 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:29.446523 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e8f24e8c-3cdb-406b-9b07-e061ab9616d2 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.206900 Jan 17 02:44:29.447084 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 679/1337] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:29 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:29.694491 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:29.695020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:29.701880 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:29.702334 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:29.703119 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:29.703554 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:29.728899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:44:29.812779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9f72e3fb-c288-4c79-9c8f-e248737cc353 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "DELETE /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 204 len: 0 microversion: 2.1 time: 0.121990 Jan 17 02:44:29.813379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 659/1338] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:44:29 2022] DELETE /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:44:29.821937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:29.822535 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:29.829098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:29.829545 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:29.830306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:29.830733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:29.967077 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:29.975282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-030e4368-2f09-45e8-94a7-6cf191833306 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1556 microversion: 2.1 time: 0.157162 Jan 17 02:44:29.975853 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 680/1339] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:29 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:44:30.469233 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:30.470470 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:30.480815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:30.481739 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:30.482579 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:30.483016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:30.632516 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:30.644911 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:30.646479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:30.647737 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a9fdd143-93e2-459f-a01a-dc5df15a1ff7 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.185366 Jan 17 02:44:30.648283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 660/1340] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:30 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:31.045413 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:31.046042 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:31.052750 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:31.053380 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:31.054147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:31.054578 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:31.272588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:31.280637 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-01df26c5-b421-4e92-9956-65d722fc1519 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1556 microversion: 2.1 time: 0.239466 Jan 17 02:44:31.281272 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 681/1341] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:31 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:44:31.667802 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:31.668487 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:31.676776 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:31.677413 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:31.678587 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:31.679214 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.173296 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:32.173814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:32.180495 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:32.181603 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.182418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:32.182848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.217265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:44:32.279501 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:32.293064 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:32.295656 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:32.299154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-57eeaf83-d609-4a55-bb25-74a49978e6b8 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.635733 Jan 17 02:44:32.312750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 661/1342] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:31 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:32.318513 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-f4aea021-65a1-470e-b944-df7ed12f4419 req-a1d09b7d-d756-447e-a630-88d6d59f6dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836aee89-f8f7-4788-8051-2d62fd7adacb", "tag": "c601475c-0c44-4ca7-a396-6569cecefedc"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:32.320238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:44:32.320238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:44:32.323514 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5322ca6e-9c85-4b49-98da-6e100c773d3f tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "DELETE /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 204 len: 0 microversion: 2.1 time: 0.153642 Jan 17 02:44:32.328003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 682/1343] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:44:32 2022] DELETE /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:44:32.328459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f4aea021-65a1-470e-b944-df7ed12f4419 req-a1d09b7d-d756-447e-a630-88d6d59f6dc2 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:32.329020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f4aea021-65a1-470e-b944-df7ed12f4419 req-a1d09b7d-d756-447e-a630-88d6d59f6dc2 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.335421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:32.336447 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:32.343975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:32.344454 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.345250 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:32.345688 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.355073 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-f4aea021-65a1-470e-b944-df7ed12f4419 req-a1d09b7d-d756-447e-a630-88d6d59f6dc2 service nova] Creating event network-changed:c601475c-0c44-4ca7-a396-6569cecefedc for instance 836aee89-f8f7-4788-8051-2d62fd7adacb on hv-cinder-82160 Jan 17 02:44:32.360077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-f4aea021-65a1-470e-b944-df7ed12f4419 req-a1d09b7d-d756-447e-a630-88d6d59f6dc2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045650 Jan 17 02:44:32.360932 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 662/1344] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:32.365862 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:32.366550 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:32.374034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:32.374483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.375268 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:32.375694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:32.649738 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b0b72a72a148d6bd409a7a4afd81c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e093625bec4998bc4012524037d1eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:32.664157 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-da46ad22-0bb1-45c8-af85-93c758416daa tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 200 len: 1556 microversion: 2.1 time: 0.332186 Jan 17 02:44:32.665035 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 683/1345] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:32 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 1556 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:44:32.675828 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:32.685236 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-27d6c23f-339f-4ccc-83c3-d40817d54cc5 tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1566 microversion: 2.1 time: 0.323195 Jan 17 02:44:32.686145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 663/1346] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:32 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1566 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:44:33.283486 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-655cd1b5-1e39-4d04-bfd8-415a7d646396 req-bedc5f52-1422-410a-becf-6c162a9e755d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834bc0c3-4bde-484a-8d9b-aab060aac09b", "name": "network-vif-plugged", "status": "completed", "tag": "8e033a10-4ded-4f31-af25-ef0b393110ad"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:33.286005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:44:33.286005 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:44:33.296622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-655cd1b5-1e39-4d04-bfd8-415a7d646396 req-bedc5f52-1422-410a-becf-6c162a9e755d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:33.297432 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-655cd1b5-1e39-4d04-bfd8-415a7d646396 req-bedc5f52-1422-410a-becf-6c162a9e755d service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:33.318350 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:33.318964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:33.324439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-655cd1b5-1e39-4d04-bfd8-415a7d646396 req-bedc5f52-1422-410a-becf-6c162a9e755d service nova] Creating event network-vif-plugged:8e033a10-4ded-4f31-af25-ef0b393110ad for instance 834bc0c3-4bde-484a-8d9b-aab060aac09b on hv-cinder-82160 Jan 17 02:44:33.326408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:33.326936 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:33.327847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:33.328627 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:33.332321 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-655cd1b5-1e39-4d04-bfd8-415a7d646396 req-bedc5f52-1422-410a-becf-6c162a9e755d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052868 Jan 17 02:44:33.333495 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 684/1347] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:33.497822 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:33.505964 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:33.507553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:33.508856 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b3bba610-0134-4de0-a7a5-c6fb661461c5 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.194295 Jan 17 02:44:33.509515 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 664/1348] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:33 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:33.681868 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:33.682561 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] [instance: 06e84400-8d07-4d52-a0af-fe7faf22466e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:33.689570 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:33.690024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:33.690811 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:33.691246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:33.702413 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:33.702996 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:33.705411 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] HTTP exception thrown: Instance 06e84400-8d07-4d52-a0af-fe7faf22466e could not be found. Jan 17 02:44:33.706145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Returning 404 to user: Instance 06e84400-8d07-4d52-a0af-fe7faf22466e could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:44:33.707086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-7678beaf-80c2-4cca-b067-63cc2b1ad2b5 tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e" status: 404 len: 111 microversion: 2.1 time: 0.029324 Jan 17 02:44:33.707639 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 685/1349] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:33 2022] GET /compute/v2.1/servers/06e84400-8d07-4d52-a0af-fe7faf22466e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:44:33.709575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:33.710024 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:33.710808 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:33.711234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:33.715440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-1ec0b101-18a1-4b56-b54c-db22f7b11a8a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] Calling method '.version_select at 0x7f074dcf78b0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:33.737398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-1ec0b101-18a1-4b56-b54c-db22f7b11a8a tempest-TestMinimumBasicScenario-1517519815 tempest-TestMinimumBasicScenario-1517519815-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1708365876" status: 202 len: 0 microversion: 2.1 time: 0.025367 Jan 17 02:44:33.737964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 686/1350] 10.222.0.24 () {58 vars in 1271 bytes} [Mon Jan 17 02:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1708365876 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:44:33.845849 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:33.853940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7ded9be6-1ae9-4dec-8d8f-ee5b688612ab tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1448 microversion: 2.1 time: 0.155139 Jan 17 02:44:33.854507 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 665/1351] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:33 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:44:34.422350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-4f89b444-e03c-49f3-872a-bad06670565a req-8382cc75-343e-46a3-9852-0fc271a30495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e84400-8d07-4d52-a0af-fe7faf22466e", "name": "network-vif-deleted", "tag": "6165ac27-1cf4-4f9d-b4a0-390a637a75d1"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:34.425936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:44:34.425936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:44:34.436484 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-4f89b444-e03c-49f3-872a-bad06670565a req-8382cc75-343e-46a3-9852-0fc271a30495 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:34.437022 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-4f89b444-e03c-49f3-872a-bad06670565a req-8382cc75-343e-46a3-9852-0fc271a30495 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:34.447975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-4f89b444-e03c-49f3-872a-bad06670565a req-8382cc75-343e-46a3-9852-0fc271a30495 service nova] Creating event network-vif-deleted:6165ac27-1cf4-4f9d-b4a0-390a637a75d1 for instance 06e84400-8d07-4d52-a0af-fe7faf22466e on hv-cinder-82160 Jan 17 02:44:34.453103 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-4f89b444-e03c-49f3-872a-bad06670565a req-8382cc75-343e-46a3-9852-0fc271a30495 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 Jan 17 02:44:34.453814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 687/1352] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:34.527093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:34.527692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:34.533697 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:34.534177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:34.534965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:34.535399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:34.748654 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:34.757559 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:34.759176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:34.760411 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-25b942ff-0d7c-416b-887b-40be52eaf003 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.237391 Jan 17 02:44:34.760970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 666/1353] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:34 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:34.872647 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:34.873463 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:34.879929 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:34.880400 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:34.881177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:34.881606 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:35.122316 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:35.130999 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d35b3465-94bf-454e-96cb-fc5b6cd56b8c tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1448 microversion: 2.1 time: 0.262576 Jan 17 02:44:35.140899 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 688/1354] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:34 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1448 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:44:35.387221 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-35789fd3-6757-4776-8864-6e14053c579d req-6b717ef1-bd0e-4dae-a0c6-9484db20353e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836aee89-f8f7-4788-8051-2d62fd7adacb", "name": "network-vif-deleted", "tag": "c601475c-0c44-4ca7-a396-6569cecefedc"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:35.389481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:44:35.389481 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:44:35.399940 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-35789fd3-6757-4776-8864-6e14053c579d req-6b717ef1-bd0e-4dae-a0c6-9484db20353e service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:35.400524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-35789fd3-6757-4776-8864-6e14053c579d req-6b717ef1-bd0e-4dae-a0c6-9484db20353e service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:35.420244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-35789fd3-6757-4776-8864-6e14053c579d req-6b717ef1-bd0e-4dae-a0c6-9484db20353e service nova] Creating event network-vif-deleted:c601475c-0c44-4ca7-a396-6569cecefedc for instance 836aee89-f8f7-4788-8051-2d62fd7adacb on hv-cinder-82160 Jan 17 02:44:35.425878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-35789fd3-6757-4776-8864-6e14053c579d req-6b717ef1-bd0e-4dae-a0c6-9484db20353e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042536 Jan 17 02:44:35.426564 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 667/1355] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:35.779440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:35.780212 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:35.791489 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:35.792214 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:35.793793 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:35.794870 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.103008 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:36.113813 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:36.115961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:36.120677 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-72cb3898-6dd2-4c1a-8c3e-c664e42d5b4f tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1732 microversion: 2.20 time: 0.345281 Jan 17 02:44:36.122242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 689/1356] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:35 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1732 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:36.152496 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:36.154169 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:36.164164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:36.165466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.167093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:36.167909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.181111 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-02b924b6-9f30-4059-b4f0-c09c3609fda8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:36.182619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-02b924b6-9f30-4059-b4f0-c09c3609fda8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:36.193982 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02b924b6-9f30-4059-b4f0-c09c3609fda8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:36.194517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02b924b6-9f30-4059-b4f0-c09c3609fda8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.195761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02b924b6-9f30-4059-b4f0-c09c3609fda8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:36.202003 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-02b924b6-9f30-4059-b4f0-c09c3609fda8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.240202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-02b924b6-9f30-4059-b4f0-c09c3609fda8 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063935 Jan 17 02:44:36.241610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 690/1357] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:36 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:36.250382 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:36.251060 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.251959 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.objects.instance [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lazy-loading 'fault' on Instance uuid 836aee89-f8f7-4788-8051-2d62fd7adacb {{(pid=122782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:44:36.255975 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-d50dd1c1-8b0c-45b3-b727-75b6eacd530a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:36.256858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-d50dd1c1-8b0c-45b3-b727-75b6eacd530a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:36.264347 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50dd1c1-8b0c-45b3-b727-75b6eacd530a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:36.265136 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50dd1c1-8b0c-45b3-b727-75b6eacd530a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.266225 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50dd1c1-8b0c-45b3-b727-75b6eacd530a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:36.266892 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-d50dd1c1-8b0c-45b3-b727-75b6eacd530a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:36.302134 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-d50dd1c1-8b0c-45b3-b727-75b6eacd530a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/206908b2-2366-478f-aaf1-cea4a0bf88b0" status: 200 len: 194 microversion: 2.1 time: 0.054430 Jan 17 02:44:36.303395 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 691/1358] 10.222.0.24 () {58 vars in 1412 bytes} [Mon Jan 17 02:44:36 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/206908b2-2366-478f-aaf1-cea4a0bf88b0 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:36.318430 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3066aac319784300b9d8f0c1c8f298ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dec6844a62b4685a182219dbf9bea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:36.329611 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-542a25e9-1fdc-48d8-92c1-abe6c09c80ee tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 200 len: 1223 microversion: 2.1 time: 0.185106 Jan 17 02:44:36.331008 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 668/1359] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:36 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 1223 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:44:37.139507 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:37.140203 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:37.146882 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:37.147418 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:37.148228 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:37.149008 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:37.282367 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:37.290156 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:37.291633 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:44:37.292795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-167bef5e-afff-43e8-93db-1afdd67ccc24 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1719 microversion: 2.20 time: 0.157476 Jan 17 02:44:37.293351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 692/1360] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:44:37 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:44:37.346977 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:37.347582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] [instance: 836aee89-f8f7-4788-8051-2d62fd7adacb] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:37.356858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:37.357323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:37.358179 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:37.358608 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:37.373018 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] HTTP exception thrown: Instance 836aee89-f8f7-4788-8051-2d62fd7adacb could not be found. Jan 17 02:44:37.373615 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Returning 404 to user: Instance 836aee89-f8f7-4788-8051-2d62fd7adacb could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:44:37.374441 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-42de2fb3-f422-4796-851f-2e7073b177cb tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb" status: 404 len: 111 microversion: 2.1 time: 0.031251 Jan 17 02:44:37.374987 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 669/1361] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:44:37 2022] GET /compute/v2.1/servers/836aee89-f8f7-4788-8051-2d62fd7adacb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:44:37.559496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ba17617d-5234-47d9-8113-25c5c2ca404d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] Calling method '.version_select at 0x7f074dd18160>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:37.600355 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ba17617d-5234-47d9-8113-25c5c2ca404d tempest-TestShelveInstance-40749713 tempest-TestShelveInstance-40749713-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-323961130" status: 202 len: 0 microversion: 2.1 time: 0.044968 Jan 17 02:44:37.601363 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 693/1362] 10.222.0.24 () {58 vars in 1250 bytes} [Mon Jan 17 02:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-323961130 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:44:37.758652 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1bd3b8b2-2c70-4662-9cad-9fdab81c5432 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0be40c2a-5630-49e5-a740-440c0e24e463"}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:44:37.760364 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1bd3b8b2-2c70-4662-9cad-9fdab81c5432 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:37.768892 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bd3b8b2-2c70-4662-9cad-9fdab81c5432 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:37.771961 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bd3b8b2-2c70-4662-9cad-9fdab81c5432 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:37.772877 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bd3b8b2-2c70-4662-9cad-9fdab81c5432 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:37.774253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1bd3b8b2-2c70-4662-9cad-9fdab81c5432 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:38.189122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1bd3b8b2-2c70-4662-9cad-9fdab81c5432 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433557 Jan 17 02:44:38.190338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 670/1363] 10.222.0.24 () {60 vars in 1322 bytes} [Mon Jan 17 02:44:37 2022] POST /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:44:45.772099 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b987dcb6-18f7-46c4-a6b9-dd4e318f4a48 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:44:45.773153 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b987dcb6-18f7-46c4-a6b9-dd4e318f4a48 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:44:45.780469 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b987dcb6-18f7-46c4-a6b9-dd4e318f4a48 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:45.780993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b987dcb6-18f7-46c4-a6b9-dd4e318f4a48 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:45.781848 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b987dcb6-18f7-46c4-a6b9-dd4e318f4a48 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:44:45.782343 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b987dcb6-18f7-46c4-a6b9-dd4e318f4a48 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:44:45.814389 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b987dcb6-18f7-46c4-a6b9-dd4e318f4a48 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045993 Jan 17 02:44:45.828498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 694/1364] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:44:45 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:45:01.318536 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-7d8277e5-8b2c-4647-9ad9-6069a896ff87 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:01.319127 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-7d8277e5-8b2c-4647-9ad9-6069a896ff87 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:01.325829 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8277e5-8b2c-4647-9ad9-6069a896ff87 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:01.326276 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8277e5-8b2c-4647-9ad9-6069a896ff87 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:01.327048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8277e5-8b2c-4647-9ad9-6069a896ff87 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:01.327471 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-7d8277e5-8b2c-4647-9ad9-6069a896ff87 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:01.356329 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-7d8277e5-8b2c-4647-9ad9-6069a896ff87 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/206908b2-2366-478f-aaf1-cea4a0bf88b0" status: 200 len: 194 microversion: 2.1 time: 0.043548 Jan 17 02:45:01.356886 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 671/1365] 10.222.0.24 () {58 vars in 1412 bytes} [Mon Jan 17 02:45:01 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/206908b2-2366-478f-aaf1-cea4a0bf88b0 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:45:01.371488 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:01.372250 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:01.381349 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:01.381799 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:01.382568 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:01.383014 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:01.473274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lazy-loading 'services' on Instance uuid e4836e82-be58-4d8d-91c3-f2bfb6aa86bd {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:45:01.551341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-21d846c3-acff-4f60-8833-6089f78c478d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/206908b2-2366-478f-aaf1-cea4a0bf88b0" status: 202 len: 0 microversion: 2.1 time: 0.185808 Jan 17 02:45:01.552158 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 695/1366] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:45:01 2022] DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/206908b2-2366-478f-aaf1-cea4a0bf88b0 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:45:03.726782 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-086b27f8-0edc-4617-987a-0b950eeaef4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:03.727355 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-086b27f8-0edc-4617-987a-0b950eeaef4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:03.733657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-086b27f8-0edc-4617-987a-0b950eeaef4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:03.734099 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-086b27f8-0edc-4617-987a-0b950eeaef4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:03.734875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-086b27f8-0edc-4617-987a-0b950eeaef4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:03.735306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-086b27f8-0edc-4617-987a-0b950eeaef4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:03.764737 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-086b27f8-0edc-4617-987a-0b950eeaef4a tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/0be40c2a-5630-49e5-a740-440c0e24e463" status: 200 len: 194 microversion: 2.1 time: 0.041813 Jan 17 02:45:03.765291 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 672/1367] 10.222.0.24 () {58 vars in 1412 bytes} [Mon Jan 17 02:45:03 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/0be40c2a-5630-49e5-a740-440c0e24e463 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:45:03.776433 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:03.777015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:03.783840 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:03.784326 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:03.785125 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:03.786015 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:03.877695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lazy-loading 'services' on Instance uuid e4836e82-be58-4d8d-91c3-f2bfb6aa86bd {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:45:03.950761 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ac1f4d1d-f1a7-46a0-a48c-f5d0a5547fa2 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/0be40c2a-5630-49e5-a740-440c0e24e463" status: 202 len: 0 microversion: 2.1 time: 0.179198 Jan 17 02:45:03.951358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 696/1368] 10.222.0.24 () {58 vars in 1415 bytes} [Mon Jan 17 02:45:03 2022] DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments/0be40c2a-5630-49e5-a740-440c0e24e463 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:45:05.115624 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-415a017f-29ad-4d61-a46f-947895586c98 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:05.116637 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-415a017f-29ad-4d61-a46f-947895586c98 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:05.123363 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-415a017f-29ad-4d61-a46f-947895586c98 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.123816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-415a017f-29ad-4d61-a46f-947895586c98 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.124618 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-415a017f-29ad-4d61-a46f-947895586c98 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.125050 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-415a017f-29ad-4d61-a46f-947895586c98 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.156462 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-415a017f-29ad-4d61-a46f-947895586c98 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044573 Jan 17 02:45:05.156980 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 673/1369] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:45:05 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:45:05.259700 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-946a0c52-6778-4f70-9a9c-cc4b5f1c7e5d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:05.260777 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-946a0c52-6778-4f70-9a9c-cc4b5f1c7e5d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:05.267275 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-946a0c52-6778-4f70-9a9c-cc4b5f1c7e5d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.267631 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-946a0c52-6778-4f70-9a9c-cc4b5f1c7e5d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.269851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-946a0c52-6778-4f70-9a9c-cc4b5f1c7e5d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.270377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-946a0c52-6778-4f70-9a9c-cc4b5f1c7e5d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.300388 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-946a0c52-6778-4f70-9a9c-cc4b5f1c7e5d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045290 Jan 17 02:45:05.300972 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 697/1370] 10.222.0.24 () {58 vars in 1301 bytes} [Mon Jan 17 02:45:05 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 02:45:05.354307 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:05.354797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:05.360605 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.361048 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.361821 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.362257 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.386437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:45:05.464112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1d955965-8135-4b45-892b-bf0a2c74e446 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 204 len: 0 microversion: 2.1 time: 0.113067 Jan 17 02:45:05.464713 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 674/1371] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:45:05 2022] DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:45:05.473162 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:05.473773 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:05.479804 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.480298 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.481081 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:05.481514 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:05.613160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:05.620802 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-950593d9-c12f-4432-809b-fc8628fb9092 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1675 microversion: 2.1 time: 0.151496 Jan 17 02:45:05.621393 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 698/1372] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:45:05 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:45:06.642858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:06.644096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:06.654999 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:06.655750 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:06.657077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:06.657795 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:06.799185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:06.807519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d25a7f94-7575-41b3-9f06-4e7972849849 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1675 microversion: 2.1 time: 0.171530 Jan 17 02:45:06.808117 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 675/1373] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:45:06 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:45:07.824879 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:07.825608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:07.832461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:07.832911 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:07.833699 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:07.834147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:07.968552 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:07.976269 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-716e6982-7c47-401d-9a6d-ec2a7f267c05 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1675 microversion: 2.1 time: 0.155086 Jan 17 02:45:07.976858 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 699/1374] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:45:07 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:45:08.533146 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-41b98e40-a04b-4f3f-ac93-9c1da593ccaa req-a811f5ae-3506-4396-aa0f-051919fe2fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4836e82-be58-4d8d-91c3-f2bfb6aa86bd", "name": "network-vif-deleted", "tag": "0502f2b8-44e9-4ef0-a037-909240354464"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:45:08.534859 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:45:08.534859 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:45:08.545019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-41b98e40-a04b-4f3f-ac93-9c1da593ccaa req-a811f5ae-3506-4396-aa0f-051919fe2fd0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:08.545578 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-41b98e40-a04b-4f3f-ac93-9c1da593ccaa req-a811f5ae-3506-4396-aa0f-051919fe2fd0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:08.558049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-41b98e40-a04b-4f3f-ac93-9c1da593ccaa req-a811f5ae-3506-4396-aa0f-051919fe2fd0 service nova] Creating event network-vif-deleted:0502f2b8-44e9-4ef0-a037-909240354464 for instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd on hv-cinder-82160 Jan 17 02:45:08.563187 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-41b98e40-a04b-4f3f-ac93-9c1da593ccaa req-a811f5ae-3506-4396-aa0f-051919fe2fd0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033676 Jan 17 02:45:08.563894 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 676/1375] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:45:08.993329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:08.994017 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:09.001089 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:09.001607 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:09.002454 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:09.002950 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:09.039246 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:09.039828 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:09.040381 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lazy-loading 'fault' on Instance uuid e4836e82-be58-4d8d-91c3-f2bfb6aa86bd {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:45:09.086310 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb2f3ca95104ea3a8c5ca882908a454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0621b37a7046b4be225145a729936f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:09.094891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b4b48001-5092-48d5-ab56-c20dc8de4855 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 200 len: 1328 microversion: 2.1 time: 0.105342 Jan 17 02:45:09.096011 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 700/1376] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:45:08 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:45:10.118599 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:10.119617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:10.130239 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:10.131005 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:10.131816 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:10.132295 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:10.145858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] HTTP exception thrown: Instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd could not be found. Jan 17 02:45:10.146494 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Returning 404 to user: Instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:10.147283 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-62866efa-ed86-415c-a291-70cff64e3087 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 404 len: 111 microversion: 2.1 time: 0.036552 Jan 17 02:45:10.148192 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 677/1377] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:45:10 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:45:10.156492 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9748b53a-a28b-4e63-a084-8fdf43b4d27d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '.version_select at 0x7f074e743550>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:10.177688 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9748b53a-a28b-4e63-a084-8fdf43b4d27d tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659246922" status: 202 len: 0 microversion: 2.1 time: 0.024626 Jan 17 02:45:10.178394 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 701/1378] 10.222.0.24 () {58 vars in 1220 bytes} [Mon Jan 17 02:45:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659246922 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:45:13.076843 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:13.077348 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:13.083970 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:13.084446 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:13.085218 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:13.085760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:13.099431 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] HTTP exception thrown: Instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd could not be found. Jan 17 02:45:13.100007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Returning 404 to user: Instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:13.100854 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0e8d1087-f46a-4c84-ac68-1fb549c76cd4 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 404 len: 111 microversion: 2.1 time: 0.027716 Jan 17 02:45:13.101469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 678/1379] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:45:13 2022] DELETE /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:45:13.110014 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:13.110608 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: e4836e82-be58-4d8d-91c3-f2bfb6aa86bd] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:13.118235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:13.118692 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:13.119474 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:13.119914 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:13.133796 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] HTTP exception thrown: Instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd could not be found. Jan 17 02:45:13.134352 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Returning 404 to user: Instance e4836e82-be58-4d8d-91c3-f2bfb6aa86bd could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:13.135168 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-97a04e18-0f83-4bb6-ad0d-965a4bd82a78 tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd" status: 404 len: 111 microversion: 2.1 time: 0.029482 Jan 17 02:45:13.135689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 702/1380] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:45:13 2022] GET /compute/v2.1/servers/e4836e82-be58-4d8d-91c3-f2bfb6aa86bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:45:14.270524 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:14.271097 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:14.278247 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:14.278692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:14.279479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:14.279904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:14.293466 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] HTTP exception thrown: Instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 could not be found. Jan 17 02:45:14.294046 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Returning 404 to user: Instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:14.294867 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ffdc7f3d-d7d7-4bf1-936d-42198590260f tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 404 len: 111 microversion: 2.1 time: 0.030705 Jan 17 02:45:14.295380 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 679/1381] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:45:14 2022] DELETE /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:45:14.303377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:14.303987 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] [instance: c3d7c373-a92e-48a3-8605-f8655cf5cba4] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:14.310821 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:14.311307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:14.312109 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:14.312554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:14.325984 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] HTTP exception thrown: Instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 could not be found. Jan 17 02:45:14.326565 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] Returning 404 to user: Instance c3d7c373-a92e-48a3-8605-f8655cf5cba4 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:14.327378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b3c1b7f0-87ef-4778-b156-ace96746089b tempest-AttachVolumeTestJSON-972241645 tempest-AttachVolumeTestJSON-972241645-project] 10.222.0.24 "GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4" status: 404 len: 111 microversion: 2.1 time: 0.027736 Jan 17 02:45:14.327895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 703/1382] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:45:14 2022] GET /compute/v2.1/servers/c3d7c373-a92e-48a3-8605-f8655cf5cba4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:45:41.549149 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-514935c8-562c-44c4-8a5c-391d04dc8a77 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:41.550061 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-514935c8-562c-44c4-8a5c-391d04dc8a77 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:41.556612 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-514935c8-562c-44c4-8a5c-391d04dc8a77 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:41.557057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-514935c8-562c-44c4-8a5c-391d04dc8a77 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:41.557831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-514935c8-562c-44c4-8a5c-391d04dc8a77 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:41.558265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-514935c8-562c-44c4-8a5c-391d04dc8a77 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:41.588472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-514935c8-562c-44c4-8a5c-391d04dc8a77 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043104 Jan 17 02:45:41.589019 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 680/1383] 10.222.0.24 () {60 vars in 1342 bytes} [Mon Jan 17 02:45:41 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:45:41.644672 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:41.645202 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:41.651814 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:41.652391 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:41.653163 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:41.653594 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:41.681556 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:45:41.762046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f3e88ea8-6c82-4913-b31f-f1f620802f46 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 204 len: 0 microversion: 2.20 time: 0.120929 Jan 17 02:45:41.762778 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 704/1384] 10.222.0.24 () {60 vars in 1279 bytes} [Mon Jan 17 02:45:41 2022] DELETE /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 02:45:41.772691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:41.773302 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:41.779273 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:41.779725 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:41.780561 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:41.780995 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:41.916311 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:41.924259 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:41.925745 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:41.926887 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-0f078550-42b4-4bb5-a5a3-939509f64f89 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.158398 Jan 17 02:45:41.927460 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 681/1385] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:41 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:42.949936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:42.951119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:42.959513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:42.959969 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:42.960780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:42.961213 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:43.095092 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:43.106943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:43.109178 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:43.110771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-4307ad31-6ddc-4a22-8210-2f2e92424704 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.167581 Jan 17 02:45:43.111544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 705/1386] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:42 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:44.147423 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:44.148598 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:44.160673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:44.161122 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:44.161903 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:44.162333 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:44.309858 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:44.318465 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:44.319948 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:44.321150 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-06580697-3388-4cb5-8f90-01a88a1ad4f4 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.184977 Jan 17 02:45:44.321735 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 682/1387] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:44 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:45.346732 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:45.347733 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:45.358336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:45.359096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:45.360476 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:45.361167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:45.500320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:45.508609 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:45.510102 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:45.511258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-90b47b3d-acce-4d06-91af-859fd6a20cc6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.170950 Jan 17 02:45:45.511826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 706/1388] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:45 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:46.534248 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:46.534965 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:46.543667 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:46.544366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:46.545386 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:46.545958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:46.693760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:46.702135 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:46.703604 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:46.704783 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d6c9a2b1-62f1-4009-8c4a-a42d5b57105d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.176902 Jan 17 02:45:46.705450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 683/1389] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:46 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:47.726137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:47.726937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:47.735602 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:47.736242 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:47.737274 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:47.737847 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:47.873671 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:47.882165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:47.883649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:47.884838 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2ef946d1-e9b8-4b49-bc3b-c4187300ed66 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.163835 Jan 17 02:45:47.885377 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 707/1390] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:47 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:48.906865 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:48.907802 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:48.918358 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:48.919127 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:48.920500 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:48.921230 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:49.054571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:49.066492 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:49.068781 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:49.070485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-47253013-61ac-44cc-b0df-40a6fe09af3a tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.169638 Jan 17 02:45:49.071186 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 684/1391] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:48 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:50.091634 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:50.092193 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:50.099054 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:50.099513 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:50.100360 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:50.100819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:50.236985 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:50.245613 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:50.247238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:50.248530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b588848c-14ee-4c56-8f22-d9b37ac7fc95 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1725 microversion: 2.20 time: 0.160771 Jan 17 02:45:50.249167 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 708/1392] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:50 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:50.857151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-e859abc1-8c49-4297-85ab-45b5e753e2d0 req-dc417cd3-fef0-4c7e-8d9c-658ef6294323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834bc0c3-4bde-484a-8d9b-aab060aac09b", "name": "network-vif-deleted", "tag": "8e033a10-4ded-4f31-af25-ef0b393110ad"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:45:50.859631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:45:50.859631 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:45:50.867586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e859abc1-8c49-4297-85ab-45b5e753e2d0 req-dc417cd3-fef0-4c7e-8d9c-658ef6294323 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:50.868356 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e859abc1-8c49-4297-85ab-45b5e753e2d0 req-dc417cd3-fef0-4c7e-8d9c-658ef6294323 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:50.891733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-e859abc1-8c49-4297-85ab-45b5e753e2d0 req-dc417cd3-fef0-4c7e-8d9c-658ef6294323 service nova] Creating event network-vif-deleted:8e033a10-4ded-4f31-af25-ef0b393110ad for instance 834bc0c3-4bde-484a-8d9b-aab060aac09b on hv-cinder-82160 Jan 17 02:45:50.897672 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-e859abc1-8c49-4297-85ab-45b5e753e2d0 req-dc417cd3-fef0-4c7e-8d9c-658ef6294323 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043596 Jan 17 02:45:50.898924 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 685/1393] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:45:51.266936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:51.267498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:51.275024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:51.275497 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:51.276315 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:51.276759 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:51.311543 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:51.312021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:51.312519 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.objects.instance [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lazy-loading 'fault' on Instance uuid 834bc0c3-4bde-484a-8d9b-aab060aac09b {{(pid=122781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 02:45:51.355030 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:51.363878 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:51.365660 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b97e9255c61a4c9fb57f59fb657a46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a07fd918d456ea8cae8d52b172382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:45:51.367567 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-71ba9ff1-c3c0-4b7e-bfb5-ad34ef3c9491 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 200 len: 1371 microversion: 2.20 time: 0.104427 Jan 17 02:45:51.368619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 709/1394] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:51 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 02:45:52.388143 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:52.388841 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:52.395252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:52.395700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:52.396510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:52.397292 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:52.410531 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] HTTP exception thrown: Instance 834bc0c3-4bde-484a-8d9b-aab060aac09b could not be found. Jan 17 02:45:52.411199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Returning 404 to user: Instance 834bc0c3-4bde-484a-8d9b-aab060aac09b could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:52.411967 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-760d0946-b1e8-4ca4-9658-841c499d63a1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 404 len: 111 microversion: 2.20 time: 0.029718 Jan 17 02:45:52.412519 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 686/1395] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:52 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 17 02:45:52.421615 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-41575bfb-df87-490d-b4b8-dd491ce051c1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '.version_select at 0x7f075045ac10>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:52.441046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-41575bfb-df87-490d-b4b8-dd491ce051c1 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564238477" status: 204 len: 0 microversion: 2.20 time: 0.023529 Jan 17 02:45:52.441620 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 710/1396] 10.222.0.24 () {60 vars in 1261 bytes} [Mon Jan 17 02:45:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564238477 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 02:45:54.275145 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:54.275650 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:54.282034 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:54.282485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:54.283261 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:54.283774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:54.297362 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] HTTP exception thrown: Instance 834bc0c3-4bde-484a-8d9b-aab060aac09b could not be found. Jan 17 02:45:54.297931 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Returning 404 to user: Instance 834bc0c3-4bde-484a-8d9b-aab060aac09b could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:54.298734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-60b7b22c-01ab-4f3a-89bd-7a20f0aeb3e9 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 404 len: 111 microversion: 2.20 time: 0.027898 Jan 17 02:45:54.299299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 687/1397] 10.222.0.24 () {60 vars in 1279 bytes} [Mon Jan 17 02:45:54 2022] DELETE /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:45:54.307989 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:54.308624 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: 834bc0c3-4bde-484a-8d9b-aab060aac09b] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:54.315827 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:54.316314 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:54.317092 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:54.317525 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:54.330703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] HTTP exception thrown: Instance 834bc0c3-4bde-484a-8d9b-aab060aac09b could not be found. Jan 17 02:45:54.331281 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Returning 404 to user: Instance 834bc0c3-4bde-484a-8d9b-aab060aac09b could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:54.332098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-40cb08f4-eeaa-4e48-9d86-2d7bc4675ea3 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b" status: 404 len: 111 microversion: 2.20 time: 0.028433 Jan 17 02:45:54.332630 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 711/1398] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:54 2022] GET /compute/v2.1/servers/834bc0c3-4bde-484a-8d9b-aab060aac09b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:45:55.479801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:55.480312 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:55.486926 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:55.487378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:55.488177 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:55.488607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:55.502102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] HTTP exception thrown: Instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 could not be found. Jan 17 02:45:55.502689 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Returning 404 to user: Instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:55.503487 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4dd0b9ea-0b1b-49e0-8882-df4d17ec1f9d tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 404 len: 111 microversion: 2.20 time: 0.027565 Jan 17 02:45:55.503993 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 688/1399] 10.222.0.24 () {60 vars in 1279 bytes} [Mon Jan 17 02:45:55 2022] DELETE /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:45:55.511745 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:45:55.512376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] [instance: d7e3840c-9200-4dfe-8879-42d7cd878ec1] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:45:55.518882 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:55.519331 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:55.520096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:45:55.520587 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:45:55.535050 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] HTTP exception thrown: Instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 could not be found. Jan 17 02:45:55.535629 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] Returning 404 to user: Instance d7e3840c-9200-4dfe-8879-42d7cd878ec1 could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:45:55.536580 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-c593743d-1009-4f23-8732-1f4adf2615d6 tempest-AttachVolumeShelveTestJSON-1479695938 tempest-AttachVolumeShelveTestJSON-1479695938-project] 10.222.0.24 "GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1" status: 404 len: 111 microversion: 2.20 time: 0.028546 Jan 17 02:45:55.537096 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 712/1400] 10.222.0.24 () {60 vars in 1276 bytes} [Mon Jan 17 02:45:55 2022] GET /compute/v2.1/servers/d7e3840c-9200-4dfe-8879-42d7cd878ec1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:46:00.077947 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8f739548-58b5-433d-8bdf-d22d5c3054cd tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Action: 'create', calling method: .version_select at 0x7f074ddfd8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1427405374", "metadata": {"Type": "work"}}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:46:00.375837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8f739548-58b5-433d-8bdf-d22d5c3054cd tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.409760 Jan 17 02:46:00.376483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 689/1401] 10.222.0.24 () {60 vars in 1155 bytes} [Mon Jan 17 02:45:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 411 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 17 02:46:00.387402 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-76841f53-f058-47ac-8c79-2cddbc114ef4 tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Calling method '.version_select at 0x7f074dc3bca0>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:00.440160 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-76841f53-f058-47ac-8c79-2cddbc114ef4 tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9" status: 200 len: 353 microversion: 2.1 time: 0.053103 Jan 17 02:46:00.440725 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 713/1402] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:46:00 2022] GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:46:01.453112 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1a3709ea-cf93-41d9-80d4-3f88c8807210 tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Calling method '.version_select at 0x7f0752fc6700>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:01.499607 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1a3709ea-cf93-41d9-80d4-3f88c8807210 tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9" status: 200 len: 354 microversion: 2.1 time: 0.050681 Jan 17 02:46:01.500199 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 690/1403] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:46:01 2022] GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:46:01.511483 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-74061bc9-c442-4c94-8d0e-f1481ca9ea3c tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Calling method '.version_select at 0x7f074e80be50>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:01.567720 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-74061bc9-c442-4c94-8d0e-f1481ca9ea3c tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9" status: 200 len: 354 microversion: 2.1 time: 0.060221 Jan 17 02:46:01.568307 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 714/1404] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:46:01 2022] GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:46:01.580029 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1b5e8cd0-a80b-461b-add4-c2d476d31797 tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Calling method '.version_select at 0x7f074defe160>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:01.650453 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1b5e8cd0-a80b-461b-add4-c2d476d31797 tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9" status: 202 len: 0 microversion: 2.1 time: 0.073937 Jan 17 02:46:01.651090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 691/1405] 10.222.0.24 () {58 vars in 1247 bytes} [Mon Jan 17 02:46:01 2022] DELETE /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:46:01.658993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-0a0600a2-e4f0-4c46-ae17-4b6fbb85593a tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Calling method '.version_select at 0x7f074e950700>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:01.704844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-0a0600a2-e4f0-4c46-ae17-4b6fbb85593a tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9" status: 200 len: 353 microversion: 2.1 time: 0.049409 Jan 17 02:46:01.705403 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 715/1406] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:46:01 2022] GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:46:02.719277 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b46cb8d6-5619-441c-b424-afbd40da985d tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Calling method '.version_select at 0x7f075308dc10>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:02.749682 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-b46cb8d6-5619-441c-b424-afbd40da985d tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] HTTP exception thrown: Volume 8a0244a7-13ee-40dc-8a21-fff2e070c2f9 could not be found. Jan 17 02:46:02.750459 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b46cb8d6-5619-441c-b424-afbd40da985d tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] Returning 404 to user: Volume 8a0244a7-13ee-40dc-8a21-fff2e070c2f9 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:46:02.751323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b46cb8d6-5619-441c-b424-afbd40da985d tempest-VolumesGetTestJSON-963806627 tempest-VolumesGetTestJSON-963806627-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9" status: 404 len: 109 microversion: 2.1 time: 0.037409 Jan 17 02:46:02.751840 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 692/1407] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:46:02 2022] GET /compute/v2.1/os-volumes/8a0244a7-13ee-40dc-8a21-fff2e070c2f9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:46:04.105949 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-36a5e8c5-0616-4071-824a-2495af81ed96 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Action: 'create', calling method: .version_select at 0x7f074e67cee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-872568002", "metadata": {"Type": "work"}}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:46:04.107367 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-36a5e8c5-0616-4071-824a-2495af81ed96 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:46:04.108184 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-36a5e8c5-0616-4071-824a-2495af81ed96 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121402 Jan 17 02:46:04.108705 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 716/1408] 10.222.0.24 () {60 vars in 1155 bytes} [Mon Jan 17 02:46:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 17 02:46:04.118801 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-817eb0d6-344c-4ee5-9df4-193a161848c0 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Action: 'create', calling method: .version_select at 0x7f075308df70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1603644118", "metadata": {"Type": "work"}}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:46:04.120265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-817eb0d6-344c-4ee5-9df4-193a161848c0 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:46:04.121042 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-817eb0d6-344c-4ee5-9df4-193a161848c0 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007059 Jan 17 02:46:04.121543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 693/1409] 10.222.0.24 () {60 vars in 1155 bytes} [Mon Jan 17 02:46:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 17 02:46:04.130145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f3418a11-e733-4064-80d7-549563a93800 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Action: 'create', calling method: .version_select at 0x7f074e80b160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1769628761", "metadata": {"Type": "work"}}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:46:04.131925 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f3418a11-e733-4064-80d7-549563a93800 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:46:04.132735 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f3418a11-e733-4064-80d7-549563a93800 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006317 Jan 17 02:46:04.133264 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 717/1410] 10.222.0.24 () {60 vars in 1155 bytes} [Mon Jan 17 02:46:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 17 02:46:04.141673 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-67a9a501-9dd4-41cc-b638-88a9f5314e92 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Calling method '.version_select at 0x7f07530333a0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:04.168196 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-67a9a501-9dd4-41cc-b638-88a9f5314e92 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] HTTP exception thrown: Volume tempest-invalid-931484544 could not be found. Jan 17 02:46:04.168780 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-67a9a501-9dd4-41cc-b638-88a9f5314e92 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Returning 404 to user: Volume tempest-invalid-931484544 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:46:04.169634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-67a9a501-9dd4-41cc-b638-88a9f5314e92 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-931484544" status: 404 len: 98 microversion: 2.1 time: 0.031555 Jan 17 02:46:04.170178 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 694/1411] 10.222.0.24 () {58 vars in 1214 bytes} [Mon Jan 17 02:46:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-931484544 => generated 98 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 17 02:46:04.179194 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-94c56380-bd04-4e00-bf84-cf39b5aea7fb tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003673 Jan 17 02:46:04.179705 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 718/1412] 10.222.0.24 () {58 vars in 1139 bytes} [Mon Jan 17 02:46:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 17 02:46:04.189315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-2ee2e350-72ed-465a-9509-140a212202f3 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004779 Jan 17 02:46:04.189904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 695/1413] 10.222.0.24 () {58 vars in 1136 bytes} [Mon Jan 17 02:46:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 17 02:46:04.198849 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-83f402a1-f088-426a-ac39-8ae631830413 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Calling method '.version_select at 0x7f0750736550>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:04.225802 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-83f402a1-f088-426a-ac39-8ae631830413 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] HTTP exception thrown: Volume 608f1abf-f5f7-44bc-b23d-4726d5e2737b could not be found. Jan 17 02:46:04.226397 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-83f402a1-f088-426a-ac39-8ae631830413 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Returning 404 to user: Volume 608f1abf-f5f7-44bc-b23d-4726d5e2737b could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:46:04.227258 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-83f402a1-f088-426a-ac39-8ae631830413 tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/608f1abf-f5f7-44bc-b23d-4726d5e2737b" status: 404 len: 109 microversion: 2.1 time: 0.032095 Jan 17 02:46:04.227775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 719/1414] 10.222.0.24 () {58 vars in 1247 bytes} [Mon Jan 17 02:46:04 2022] DELETE /compute/v2.1/os-volumes/608f1abf-f5f7-44bc-b23d-4726d5e2737b => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:46:04.237503 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-701a145b-cfc0-4ecb-b533-f7e712021c7d tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Calling method '.version_select at 0x7f0753071af0>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:46:04.263606 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-701a145b-cfc0-4ecb-b533-f7e712021c7d tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] HTTP exception thrown: Volume 336ea9b9-a0db-40ac-a18e-0e2dad3c7ba7 could not be found. Jan 17 02:46:04.264250 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-701a145b-cfc0-4ecb-b533-f7e712021c7d tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] Returning 404 to user: Volume 336ea9b9-a0db-40ac-a18e-0e2dad3c7ba7 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:46:04.265074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-701a145b-cfc0-4ecb-b533-f7e712021c7d tempest-VolumesNegativeTest-449167370 tempest-VolumesNegativeTest-449167370-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/336ea9b9-a0db-40ac-a18e-0e2dad3c7ba7" status: 404 len: 109 microversion: 2.1 time: 0.031574 Jan 17 02:46:04.270859 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 696/1415] 10.222.0.24 () {58 vars in 1244 bytes} [Mon Jan 17 02:46:04 2022] GET /compute/v2.1/os-volumes/336ea9b9-a0db-40ac-a18e-0e2dad3c7ba7 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:47:22.488696 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9608c685-6560-4e20-8f2e-382908e92eda tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Action: 'create', calling method: .version_select at 0x7f074dce1670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-71927295"}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:47:22.502703 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-9608c685-6560-4e20-8f2e-382908e92eda tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:47:22.507239 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-9608c685-6560-4e20-8f2e-382908e92eda tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for user be8898f4f5a045c0b1309bfc171c7d62 and project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:47:22.670636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-9608c685-6560-4e20-8f2e-382908e92eda tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:47:22.676376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-9608c685-6560-4e20-8f2e-382908e92eda tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for user be8898f4f5a045c0b1309bfc171c7d62 and project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'key_pairs'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:47:22.691511 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9608c685-6560-4e20-8f2e-382908e92eda tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.369471 Jan 17 02:47:22.693508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 720/1416] 10.222.0.24 () {60 vars in 1157 bytes} [Mon Jan 17 02:47:22 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:44.267861 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1133379867", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-71927295", "security_groups": [{"name": "tempest-secgroup-smoke-2144913197"}], "block_device_mapping_v2": [{"uuid": "124868ba-2300-4686-8bce-9d8a464055a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "660ee0d2-ff63-4e21-854f-357c6aa22718"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:47:44.390535 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] validate_networks() for [('660ee0d2-ff63-4e21-854f-357c6aa22718', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:47:44.904758 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:47:44.905231 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:47:44.905692 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:47:44.906090 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:47:44.906489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:47:44.915082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:44.915543 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:44.916528 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:44.917007 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:44.935241 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:47:44.939498 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for user be8898f4f5a045c0b1309bfc171c7d62 and project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:47:44.998343 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:47:45.000663 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='124868ba-2300-4686-8bce-9d8a464055a3',volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:47:45.130453 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [de50e6ca-fea9-4903-8663-c51cf3a082ed] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:47:46.139097 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [de50e6ca-fea9-4903-8663-c51cf3a082ed] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 52806. Jan 17 02:47:46.143770 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-abdd163b-3601-477b-b429-e44e866e5d1e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.881961 Jan 17 02:47:46.144437 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 697/1417] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:47:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:47:46.155254 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-5094d036-630d-43be-a1ab-37069a363b8d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:46.155829 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-5094d036-630d-43be-a1ab-37069a363b8d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:46.205836 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-5094d036-630d-43be-a1ab-37069a363b8d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:46.212956 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-5094d036-630d-43be-a1ab-37069a363b8d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1093 microversion: 2.1 time: 0.061960 Jan 17 02:47:46.213510 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 721/1418] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:46 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1093 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:47.230172 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fa9080e3-bc8f-450a-ab25-ac09774f1b68 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:47.230850 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fa9080e3-bc8f-450a-ab25-ac09774f1b68 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:47.286717 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fa9080e3-bc8f-450a-ab25-ac09774f1b68 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:47.293552 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fa9080e3-bc8f-450a-ab25-ac09774f1b68 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1093 microversion: 2.1 time: 0.067627 Jan 17 02:47:47.294147 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 698/1419] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:47 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:48.312411 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b07d20f4-2521-4a3d-95ea-d173e16f5939 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:48.313133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b07d20f4-2521-4a3d-95ea-d173e16f5939 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:48.373866 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b07d20f4-2521-4a3d-95ea-d173e16f5939 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:48.380702 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b07d20f4-2521-4a3d-95ea-d173e16f5939 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1093 microversion: 2.1 time: 0.073133 Jan 17 02:47:48.381263 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 722/1420] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:48 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:49.401827 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-fd44689f-b042-435a-9035-4a354f976417 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:49.402848 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-fd44689f-b042-435a-9035-4a354f976417 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:49.454397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-fd44689f-b042-435a-9035-4a354f976417 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:49.461381 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-fd44689f-b042-435a-9035-4a354f976417 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1093 microversion: 2.1 time: 0.066171 Jan 17 02:47:49.461956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 699/1421] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:49 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:50.482111 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:50.483098 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:50.494233 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:50.494964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:50.496318 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:50.497033 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:50.558265 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:50.566335 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9ade7c4f-abeb-4dcc-bda4-e9d2a61ce460 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1143 microversion: 2.1 time: 0.090422 Jan 17 02:47:50.566903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 723/1422] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:50 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:51.582955 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:51.583569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:51.592096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:51.593592 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:51.594252 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:51.594880 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:51.655228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:51.662573 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ee262622-4495-45ba-b2af-d618c1e147f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1209 microversion: 2.1 time: 0.083411 Jan 17 02:47:51.663139 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 700/1423] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:51 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:52.681238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:52.681843 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:52.688436 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:52.688886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:52.689678 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:52.690108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:52.835190 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:52.845530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9e2734cc-8e9b-417e-8208-033a3f503557 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.167580 Jan 17 02:47:52.860201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 724/1424] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:52 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:52.892649 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-9639c11c-aba5-4fcc-bce1-392f4c5ea6ac req-25421389-e34b-4c42-ad47-84806aa0aed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f51f9f-61be-4b32-b9e7-1d49673a021e", "tag": "a02298e0-0128-4eb8-8ba4-b0c67a89c0bd"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:47:52.895164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:47:52.895164 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:47:52.902772 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-9639c11c-aba5-4fcc-bce1-392f4c5ea6ac req-25421389-e34b-4c42-ad47-84806aa0aed6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:52.903386 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-9639c11c-aba5-4fcc-bce1-392f4c5ea6ac req-25421389-e34b-4c42-ad47-84806aa0aed6 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:52.915775 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-9639c11c-aba5-4fcc-bce1-392f4c5ea6ac req-25421389-e34b-4c42-ad47-84806aa0aed6 service nova] Creating event network-changed:a02298e0-0128-4eb8-8ba4-b0c67a89c0bd for instance 54f51f9f-61be-4b32-b9e7-1d49673a021e on hv-cinder-82160 Jan 17 02:47:52.919151 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: ERROR oslo.messaging._drivers.impl_rabbit [req-9639c11c-aba5-4fcc-bce1-392f4c5ea6ac req-25421389-e34b-4c42-ad47-84806aa0aed6 service nova] [f4afc162-704b-4e45-9c37-6e31d5b802b3] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:47:53.866872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:53.867477 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:53.874145 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:53.874594 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:53.875351 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:53.875809 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:53.928148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [req-9639c11c-aba5-4fcc-bce1-392f4c5ea6ac req-25421389-e34b-4c42-ad47-84806aa0aed6 service nova] [f4afc162-704b-4e45-9c37-6e31d5b802b3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 52850. Jan 17 02:47:53.932295 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-9639c11c-aba5-4fcc-bce1-392f4c5ea6ac req-25421389-e34b-4c42-ad47-84806aa0aed6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.116215 Jan 17 02:47:53.932984 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 701/1425] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 02:47:54.021121 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:54.029460 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2d35bdf8-eb9a-44ae-8fd9-4a45a2b466ac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.166324 Jan 17 02:47:54.030259 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 725/1426] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:53 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:55.051939 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:55.053251 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:55.063473 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:55.063927 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:55.064744 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:55.065184 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:55.206578 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:55.217250 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c4582443-fced-4fbc-a18c-88443eef803e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.172801 Jan 17 02:47:55.218093 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 702/1427] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:55 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:55.698049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:47:55.698472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:47:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:47:56.238610 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:56.239771 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:56.250127 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:56.250872 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:56.252152 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:56.252938 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:56.401417 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:56.409548 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-6f3437ae-e793-4e7c-9b45-acc3dc1374eb tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.177344 Jan 17 02:47:56.410189 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 726/1428] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:56 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:57.428295 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:57.429125 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:57.442322 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:57.442824 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:57.443628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:57.444091 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:57.584789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:57.595084 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b205434c-a760-4fbf-817a-ebcee8b3124f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.170877 Jan 17 02:47:57.595886 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 703/1429] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:57 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:58.619199 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:58.620728 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:58.628744 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:58.629158 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:58.629930 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:58.630358 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:58.782181 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:58.794472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-18d11d1d-0594-483e-a3ae-fc0de24d1eca tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.181307 Jan 17 02:47:58.795285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 727/1430] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:58 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:47:59.816351 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:47:59.817287 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:47:59.828163 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:59.828731 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:59.829510 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:47:59.829937 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:47:59.962594 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:47:59.970675 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-a448ab5d-4dec-4389-be82-f5e572867e60 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.160583 Jan 17 02:47:59.971235 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 704/1431] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:47:59 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:00.992165 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:00.993152 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:01.002058 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:01.002500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:01.003268 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:01.003695 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:01.147112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:01.158553 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-722d326d-2707-4829-abf3-515a48772e57 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.172488 Jan 17 02:48:01.159254 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 728/1432] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:00 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:02.183709 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:02.187780 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:02.196956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:02.197408 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:02.198191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:02.198634 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:02.336997 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:02.344472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5365c397-3466-40ee-b3f1-75bf9f254eba tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.167186 Jan 17 02:48:02.345038 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 705/1433] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:02 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:03.365543 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:03.366582 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:03.377280 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:03.378027 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:03.379312 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:03.380028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:03.515634 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:03.523461 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-b57540c6-f9e6-4682-a47a-079434f23c71 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.164158 Jan 17 02:48:03.524001 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 729/1434] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:03 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:04.544935 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:04.545797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:04.556563 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:04.557299 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:04.558568 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:04.559278 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:04.699898 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:04.708691 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-05ee5c93-24ea-4f1c-9ff8-c9de28a523ed tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.170089 Jan 17 02:48:04.709262 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 706/1435] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:04 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:05.146482 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-b81174b3-6ada-46f7-978a-616c5e5ca5b3 req-6a88cac5-0b17-45a2-b267-caec83c9b7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f51f9f-61be-4b32-b9e7-1d49673a021e", "name": "network-vif-plugged", "status": "completed", "tag": "a02298e0-0128-4eb8-8ba4-b0c67a89c0bd"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:48:05.148227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:48:05.148227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:48:05.155173 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-b81174b3-6ada-46f7-978a-616c5e5ca5b3 req-6a88cac5-0b17-45a2-b267-caec83c9b7a5 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:05.155615 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-b81174b3-6ada-46f7-978a-616c5e5ca5b3 req-6a88cac5-0b17-45a2-b267-caec83c9b7a5 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:05.166713 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-b81174b3-6ada-46f7-978a-616c5e5ca5b3 req-6a88cac5-0b17-45a2-b267-caec83c9b7a5 service nova] Creating event network-vif-plugged:a02298e0-0128-4eb8-8ba4-b0c67a89c0bd for instance 54f51f9f-61be-4b32-b9e7-1d49673a021e on hv-cinder-82160 Jan 17 02:48:05.170260 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: ERROR oslo.messaging._drivers.impl_rabbit [req-b81174b3-6ada-46f7-978a-616c5e5ca5b3 req-6a88cac5-0b17-45a2-b267-caec83c9b7a5 service nova] [33d9e92d-9660-42b8-988b-8d26f7fe01d1] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:48:05.729148 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:05.730095 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:05.738612 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:05.739349 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:05.740173 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:05.740616 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:05.875451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:05.883425 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-81600762-50ef-4ebe-969a-df9443c45161 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.160286 Jan 17 02:48:05.883979 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 707/1436] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:05 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:06.181586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [req-b81174b3-6ada-46f7-978a-616c5e5ca5b3 req-6a88cac5-0b17-45a2-b267-caec83c9b7a5 service nova] [33d9e92d-9660-42b8-988b-8d26f7fe01d1] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 52878. Jan 17 02:48:06.188172 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-b81174b3-6ada-46f7-978a-616c5e5ca5b3 req-6a88cac5-0b17-45a2-b267-caec83c9b7a5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.101387 Jan 17 02:48:06.189133 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 730/1437] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:48:06.904811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:06.905814 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:06.913253 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:06.913700 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:06.914483 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:06.914913 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:07.056616 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:07.068489 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-dfc20fa7-6bb0-4767-821b-38b45002f16e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1265 microversion: 2.1 time: 0.169714 Jan 17 02:48:07.069338 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 708/1438] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:06 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:08.095146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:08.095841 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:08.102883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:08.103334 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:08.104135 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:08.104585 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:08.242891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:08.251161 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-71839011-f73f-4508-a951-aebb2a61c4fd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1452 microversion: 2.1 time: 0.163736 Jan 17 02:48:08.251782 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 731/1439] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:08 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:08.271413 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:48:08.271992 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:48:08.278862 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:08.279310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:08.280094 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:08.280571 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:08.415596 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:48:08.427949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-10d1e52c-01b1-4f2c-88ba-d81182d02ffd tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1452 microversion: 2.1 time: 0.160280 Jan 17 02:48:08.428767 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 709/1440] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:48:08 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:48:10.373730 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-2f6d58b7-7f32-432f-afb3-aad631ac9a15 req-1debeaea-5d82-43cb-b84b-d626e2d8c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f51f9f-61be-4b32-b9e7-1d49673a021e", "tag": "a02298e0-0128-4eb8-8ba4-b0c67a89c0bd"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:48:10.375350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:48:10.375350 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:48:10.382883 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-2f6d58b7-7f32-432f-afb3-aad631ac9a15 req-1debeaea-5d82-43cb-b84b-d626e2d8c1d4 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:48:10.383324 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-2f6d58b7-7f32-432f-afb3-aad631ac9a15 req-1debeaea-5d82-43cb-b84b-d626e2d8c1d4 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:48:10.394292 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-2f6d58b7-7f32-432f-afb3-aad631ac9a15 req-1debeaea-5d82-43cb-b84b-d626e2d8c1d4 service nova] Creating event network-changed:a02298e0-0128-4eb8-8ba4-b0c67a89c0bd for instance 54f51f9f-61be-4b32-b9e7-1d49673a021e on hv-cinder-82160 Jan 17 02:48:10.399625 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-2f6d58b7-7f32-432f-afb3-aad631ac9a15 req-1debeaea-5d82-43cb-b84b-d626e2d8c1d4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029764 Jan 17 02:48:10.400245 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 732/1441] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:49:31.893069 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:49:31.893805 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 02:49:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:50:18.427124 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:50:18.428565 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 02:50:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:50:24.746244 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb54f0bf-7465-4ec0-997c-88e8abc97e4e] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 17 02:50:24.750265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:24.750809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:24.757899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:24.758399 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:24.759267 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:24.759839 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:24.784565 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Going to try to terminate instance {{(pid=122782) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:50:24.863036 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-3b41f087-e86f-4275-a005-0cb2a2a58628 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "DELETE /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 204 len: 0 microversion: 2.1 time: 0.119324 Jan 17 02:50:24.863659 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 710/1442] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:50:24 2022] DELETE /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:50:24.871365 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: ERROR oslo.messaging._drivers.impl_rabbit [-] [27b681af-da91-414e-9627-760ff3daae51] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:50:24.875306 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:24.876008 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:24.882961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:24.883406 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:24.884201 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:24.884632 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:25.132101 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:25.140376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a3a196c4-43e4-438c-94ab-7ebea6a8f056 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1576 microversion: 2.1 time: 0.270990 Jan 17 02:50:25.140936 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 733/1443] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:24 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1576 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:26.160764 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:26.161648 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:26.172582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:26.173154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:26.174135 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:26.174678 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:26.192366 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb54f0bf-7465-4ec0-997c-88e8abc97e4e] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 52946. Jan 17 02:50:26.381369 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:26.389579 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-e2ba5520-49d6-47a1-9d0d-31ff46084984 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1576 microversion: 2.1 time: 0.233987 Jan 17 02:50:26.390153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 711/1444] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:26 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:27.411068 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:27.411625 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:27.419344 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:27.419781 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:27.420623 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:27.421053 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:27.427137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] [27b681af-da91-414e-9627-760ff3daae51] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 52952. Jan 17 02:50:27.487751 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:27.495509 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-caced5cf-0d8b-49a9-b8ed-5cc173e7289a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 200 len: 1508 microversion: 2.1 time: 0.088124 Jan 17 02:50:27.496046 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 734/1445] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:27 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 1508 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:27.591223 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-f336b4aa-8de3-4344-9904-8073b20563ef req-e68d0135-8c5d-446a-99de-5e8cf29151d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f51f9f-61be-4b32-b9e7-1d49673a021e", "name": "network-vif-deleted", "tag": "a02298e0-0128-4eb8-8ba4-b0c67a89c0bd"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:50:27.592761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:50:27.592761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:50:27.600138 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f336b4aa-8de3-4344-9904-8073b20563ef req-e68d0135-8c5d-446a-99de-5e8cf29151d0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:27.601002 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-f336b4aa-8de3-4344-9904-8073b20563ef req-e68d0135-8c5d-446a-99de-5e8cf29151d0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:27.611551 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-f336b4aa-8de3-4344-9904-8073b20563ef req-e68d0135-8c5d-446a-99de-5e8cf29151d0 service nova] Creating event network-vif-deleted:a02298e0-0128-4eb8-8ba4-b0c67a89c0bd for instance 54f51f9f-61be-4b32-b9e7-1d49673a021e on hv-cinder-82160 Jan 17 02:50:27.616819 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-f336b4aa-8de3-4344-9904-8073b20563ef req-e68d0135-8c5d-446a-99de-5e8cf29151d0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029241 Jan 17 02:50:27.620479 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 712/1446] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:50:28.512224 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:28.512826 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:28.519969 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:28.520446 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:28.521235 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:28.521666 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:28.536551 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] HTTP exception thrown: Instance 54f51f9f-61be-4b32-b9e7-1d49673a021e could not be found. Jan 17 02:50:28.537146 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Returning 404 to user: Instance 54f51f9f-61be-4b32-b9e7-1d49673a021e could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:50:28.537983 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-21cdbc05-3fa5-478c-94bf-55a6f9145afe tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 404 len: 111 microversion: 2.1 time: 0.029780 Jan 17 02:50:28.538866 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 735/1447] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:28 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:50:28.588572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-510736117", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-71927295", "security_groups": [{"name": "tempest-secgroup-smoke-2144913197"}], "block_device_mapping_v2": [{"uuid": "124868ba-2300-4686-8bce-9d8a464055a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "660ee0d2-ff63-4e21-854f-357c6aa22718"}]}} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:50:28.700370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.network.neutron [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] validate_networks() for [('660ee0d2-ff63-4e21-854f-357c6aa22718', None, None, None, None, None)] {{(pid=122782) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:50:29.079057 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Flavor limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:50:29.079651 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Image limits 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:50:29.080298 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Flavor pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:50:29.080837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Image pref 0:0:0 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:50:29.081397 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.virt.hardware [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:50:29.095542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:29.095542 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:29.096426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:29.096426 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:29.119557 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:50:29.124154 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.quota [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for user be8898f4f5a045c0b1309bfc171c7d62 and project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'ram', 'cores', 'instances'} {{(pid=122782) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:50:29.181881 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Going to run 1 instances... {{(pid=122782) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:50:29.184100 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='124868ba-2300-4686-8bce-9d8a464055a3',volume_size=None,volume_type=None)] {{(pid=122782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:50:29.315240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-64a5edd6-c0df-49a2-a715-d886a3b329dc tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730720 Jan 17 02:50:29.315875 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 713/1448] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:50:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:50:29.325844 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e54dffff-1a52-4728-9abf-754a6ab22911 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:29.326510 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e54dffff-1a52-4728-9abf-754a6ab22911 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:29.377035 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e54dffff-1a52-4728-9abf-754a6ab22911 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:29.383842 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e54dffff-1a52-4728-9abf-754a6ab22911 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1092 microversion: 2.1 time: 0.061538 Jan 17 02:50:29.384300 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 736/1449] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:29 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1092 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:30.402323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:30.403012 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:30.409588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:30.410213 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:30.411256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:30.411400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:30.476733 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:30.483986 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5455640e-38b7-4da8-9847-139481a1d7a9 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1208 microversion: 2.1 time: 0.086854 Jan 17 02:50:30.484630 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 714/1450] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:30 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:31.501311 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:31.502345 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:31.510115 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:31.510682 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:31.511554 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:31.512057 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:31.648605 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:31.657636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-9c7ff5a5-a3b5-4cb2-9ba8-d6f911aa6594 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.160044 Jan 17 02:50:31.658500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 737/1451] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:31 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:31.698323 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-3615adbf-19b4-4f46-935c-46c0a96e7e9f req-38e6e4cc-3867-4dee-9974-dae63f8906d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8101de1a-f163-4b09-affe-30cee1520021", "tag": "7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:50:31.700035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:50:31.700035 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:50:31.708485 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-3615adbf-19b4-4f46-935c-46c0a96e7e9f req-38e6e4cc-3867-4dee-9974-dae63f8906d0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:31.713410 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-3615adbf-19b4-4f46-935c-46c0a96e7e9f req-38e6e4cc-3867-4dee-9974-dae63f8906d0 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:31.730722 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-3615adbf-19b4-4f46-935c-46c0a96e7e9f req-38e6e4cc-3867-4dee-9974-dae63f8906d0 service nova] Creating event network-changed:7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa for instance 8101de1a-f163-4b09-affe-30cee1520021 on hv-cinder-82160 Jan 17 02:50:31.737123 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-3615adbf-19b4-4f46-935c-46c0a96e7e9f req-38e6e4cc-3867-4dee-9974-dae63f8906d0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043700 Jan 17 02:50:31.737994 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 715/1452] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:50:32.674454 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:32.675028 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:32.682047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:32.682498 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:32.683387 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:32.683819 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:32.819900 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:32.827423 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-46def732-1616-458d-999d-3af66899d1db tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.156659 Jan 17 02:50:32.827988 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 738/1453] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:32 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:33.845591 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:33.846308 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:33.853021 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:33.853472 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:33.854256 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:33.854695 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:33.989463 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:33.997294 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-735d08fd-ff34-4c67-ab99-9aac85a1e89b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.156208 Jan 17 02:50:33.997861 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 716/1454] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:33 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:35.017881 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:35.019195 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:35.029649 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:35.030108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:35.030891 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:35.031330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:35.182588 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:35.190049 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-186b455d-c8dc-41d9-a0c1-4cbdcb04bb23 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.178447 Jan 17 02:50:35.190611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 739/1455] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:35 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:36.208116 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:36.208715 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:36.215647 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:36.216106 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:36.216930 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:36.217364 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:36.358638 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:36.367971 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ae40b77b-49c2-4876-8727-acd04360301e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.164307 Jan 17 02:50:36.368586 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 717/1456] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:36 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:37.389223 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:37.390177 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:37.400291 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:37.400739 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:37.401505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:37.401937 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:37.554154 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:37.562866 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-131dde44-799d-484e-a1f5-b2ca2a3c404d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.179837 Jan 17 02:50:37.563431 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 740/1457] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:37 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:38.583951 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:38.584873 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:38.595617 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:38.596442 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:38.597734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:38.598450 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:38.729831 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:38.737553 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-191a9fcf-e359-41e8-abe5-feca2e96d126 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.159959 Jan 17 02:50:38.738121 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 718/1458] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:38 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:39.758601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:39.759577 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:39.768141 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:39.769148 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:39.770366 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:39.771085 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:39.910188 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:39.917806 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-bb2e0804-a485-4208-badb-7210a67b03a8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.165476 Jan 17 02:50:39.918378 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 741/1459] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:39 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:40.938785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:40.939809 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:40.950369 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:40.951120 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:40.952467 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:40.953191 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:41.093038 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:41.100888 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-1d013d64-8e23-4dec-86b3-1552d1cacb79 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.168209 Jan 17 02:50:41.101454 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 719/1460] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:40 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:41.999989 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-187e9b9f-c3a2-4a8f-aed1-b002e6514cc4 req-4e0d7852-5935-4ba4-b096-0e878823961f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8101de1a-f163-4b09-affe-30cee1520021", "name": "network-vif-plugged", "status": "completed", "tag": "7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:50:42.001691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:50:42.001691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:50:42.009288 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-187e9b9f-c3a2-4a8f-aed1-b002e6514cc4 req-4e0d7852-5935-4ba4-b096-0e878823961f service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:42.009731 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-187e9b9f-c3a2-4a8f-aed1-b002e6514cc4 req-4e0d7852-5935-4ba4-b096-0e878823961f service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:42.021662 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-187e9b9f-c3a2-4a8f-aed1-b002e6514cc4 req-4e0d7852-5935-4ba4-b096-0e878823961f service nova] Creating event network-vif-plugged:7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa for instance 8101de1a-f163-4b09-affe-30cee1520021 on hv-cinder-82160 Jan 17 02:50:42.026711 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-187e9b9f-c3a2-4a8f-aed1-b002e6514cc4 req-4e0d7852-5935-4ba4-b096-0e878823961f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 Jan 17 02:50:42.027472 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 742/1461] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:50:42.118077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:42.118680 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:42.125469 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:42.125830 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:42.126614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:42.127049 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:42.264786 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:42.275357 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-5a4270a3-dddd-497e-b68e-f261f9673428 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.160950 Jan 17 02:50:42.275958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 720/1462] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:42 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:43.293285 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:43.293920 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:43.300902 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:43.301287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:43.302064 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:43.302491 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:43.442074 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:43.450438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-8b88140c-5357-44ff-87db-447df2966ac8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1264 microversion: 2.1 time: 0.161246 Jan 17 02:50:43.451017 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 743/1463] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:43 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:44.475250 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:44.476319 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:44.484411 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:44.484909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:44.485760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:44.486238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:44.624023 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:44.635134 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-07fdfc50-8de0-433f-a40a-68ce31b5dd38 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1452 microversion: 2.1 time: 0.165567 Jan 17 02:50:44.635888 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 721/1464] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:44 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:44.652220 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:50:44.652855 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:50:44.659626 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:44.660166 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:44.660895 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:44.661330 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:44.801287 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:50:44.809079 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-30201301-87d1-4545-8a3f-7ff18ec57f82 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1452 microversion: 2.1 time: 0.160694 Jan 17 02:50:44.809659 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 744/1465] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:50:44 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:50:46.800310 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-4f01222f-42a3-437c-9d96-16208801aa27 req-55ce7f85-1f9b-4710-bb14-bfaa502c1306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8101de1a-f163-4b09-affe-30cee1520021", "tag": "7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:50:46.801904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:50:46.801904 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:50:46.809185 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-4f01222f-42a3-437c-9d96-16208801aa27 req-55ce7f85-1f9b-4710-bb14-bfaa502c1306 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:50:46.809625 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-4f01222f-42a3-437c-9d96-16208801aa27 req-55ce7f85-1f9b-4710-bb14-bfaa502c1306 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:50:46.820614 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-4f01222f-42a3-437c-9d96-16208801aa27 req-55ce7f85-1f9b-4710-bb14-bfaa502c1306 service nova] Creating event network-changed:7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa for instance 8101de1a-f163-4b09-affe-30cee1520021 on hv-cinder-82160 Jan 17 02:50:46.825732 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-4f01222f-42a3-437c-9d96-16208801aa27 req-55ce7f85-1f9b-4710-bb14-bfaa502c1306 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029073 Jan 17 02:50:46.826563 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 722/1466] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:51:15.712344 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:51:15.713474 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:51:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:52:49.157480 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1178085718", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-71927295", "security_groups": [{"name": "tempest-secgroup-smoke-2144913197"}], "block_device_mapping_v2": [{"uuid": "6958f329-59d7-4bd8-9d2c-6d00505be710", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "660ee0d2-ff63-4e21-854f-357c6aa22718"}]}} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:52:49.268867 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.network.neutron [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] validate_networks() for [('660ee0d2-ff63-4e21-854f-357c6aa22718', None, None, None, None, None)] {{(pid=122781) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 02:52:49.713100 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Flavor limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 02:52:49.713642 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Image limits 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 02:52:49.714622 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Flavor pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 02:52:49.715261 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Image pref 0:0:0 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 02:52:49.715851 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.virt.hardware [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 02:52:49.726979 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:49.727428 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:49.728276 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:49.728710 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:49.746376 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 02:52:49.750763 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.quota [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Getting quotas for user be8898f4f5a045c0b1309bfc171c7d62 and project 9a5fffc31fb74051bb8478ab98082f04. Resources: {'ram', 'cores', 'instances'} {{(pid=122781) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 02:52:49.814846 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Going to run 1 instances... {{(pid=122781) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 02:52:49.817137 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6958f329-59d7-4bd8-9d2c-6d00505be710',volume_size=None,volume_type=None)] {{(pid=122781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 02:52:49.945924 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: ERROR oslo.messaging._drivers.impl_rabbit [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [7b42998f-0266-4e55-bbb2-f7c69b38b3b3] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:52:50.956294 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [7b42998f-0266-4e55-bbb2-f7c69b38b3b3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 53110. Jan 17 02:52:50.960776 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-be065283-3f95-4fd9-9fa5-072d3d13ddc1 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.811013 Jan 17 02:52:50.961422 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 745/1467] 10.222.0.24 () {60 vars in 1146 bytes} [Mon Jan 17 02:52:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 02:52:50.969803 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb54f0bf-7465-4ec0-997c-88e8abc97e4e] AMQP server on 10.222.0.24:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 17 02:52:50.974382 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-917612ca-7957-44b6-92f2-abfc0f94821d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:50.975072 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-917612ca-7957-44b6-92f2-abfc0f94821d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:51.026774 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-917612ca-7957-44b6-92f2-abfc0f94821d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:51.034003 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-917612ca-7957-44b6-92f2-abfc0f94821d tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1093 microversion: 2.1 time: 0.066122 Jan 17 02:52:51.034569 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 723/1468] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:50 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:52.057601 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-968d18ff-bc01-4ecc-a17b-67fed56c328a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:52.058189 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-968d18ff-bc01-4ecc-a17b-67fed56c328a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:52.108435 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-968d18ff-bc01-4ecc-a17b-67fed56c328a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:52.115276 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-968d18ff-bc01-4ecc-a17b-67fed56c328a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1093 microversion: 2.1 time: 0.062297 Jan 17 02:52:52.115775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 746/1469] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:52 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1093 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:53.135956 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-9b96ba6e-a07a-4f7f-928b-22f41d00a1e8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:53.137930 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-9b96ba6e-a07a-4f7f-928b-22f41d00a1e8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:53.164878 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb54f0bf-7465-4ec0-997c-88e8abc97e4e] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 53136. Jan 17 02:52:53.193916 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-9b96ba6e-a07a-4f7f-928b-22f41d00a1e8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:53.201078 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-9b96ba6e-a07a-4f7f-928b-22f41d00a1e8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1093 microversion: 2.1 time: 0.071439 Jan 17 02:52:53.201660 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 724/1470] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:53 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:54.220943 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-3f10ed3a-0a94-4ec4-ad55-b2d66699936a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:54.221961 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-3f10ed3a-0a94-4ec4-ad55-b2d66699936a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:54.288617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-3f10ed3a-0a94-4ec4-ad55-b2d66699936a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:54.295444 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-3f10ed3a-0a94-4ec4-ad55-b2d66699936a tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1093 microversion: 2.1 time: 0.080606 Jan 17 02:52:54.296031 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 747/1471] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:54 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:54.695681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:52:54.696645 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:52:55.311610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:55.312240 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:55.319138 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:55.319582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:55.320389 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:55.320806 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:55.378797 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:55.386153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bb40b94e-1ed7-4c94-8032-30ecce6ae188 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1143 microversion: 2.1 time: 0.078302 Jan 17 02:52:55.386712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 725/1472] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:55 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1143 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:56.403290 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:56.403889 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:56.411500 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:56.411951 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:56.412780 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:56.413281 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:56.472368 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:56.479919 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-14034629-0848-446f-9092-c14acacc3bac tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1209 microversion: 2.1 time: 0.080479 Jan 17 02:52:56.480766 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 748/1473] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:56 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:57.496963 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:57.498657 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:57.512297 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:57.513102 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:57.514736 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:57.515538 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:57.583789 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [req-a192d528-faa2-4364-8444-ddf6e591e285 req-27ae359d-6820-484e-9f45-852aa7c3a4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa23975-4d62-4b66-9863-156b9e5f8d29", "tag": "ae80d547-f803-4ef6-9d6d-dda79cbe5722"}]} {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:52:57.585860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:52:57.585860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: warnings.warn(msg) Jan 17 02:52:57.596420 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-a192d528-faa2-4364-8444-ddf6e591e285 req-27ae359d-6820-484e-9f45-852aa7c3a4e5 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:57.597282 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [req-a192d528-faa2-4364-8444-ddf6e591e285 req-27ae359d-6820-484e-9f45-852aa7c3a4e5 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:57.614972 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.compute.server_external_events [req-a192d528-faa2-4364-8444-ddf6e591e285 req-27ae359d-6820-484e-9f45-852aa7c3a4e5 service nova] Creating event network-changed:ae80d547-f803-4ef6-9d6d-dda79cbe5722 for instance 2fa23975-4d62-4b66-9863-156b9e5f8d29 on hv-cinder-82160 Jan 17 02:52:57.620470 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [req-a192d528-faa2-4364-8444-ddf6e591e285 req-27ae359d-6820-484e-9f45-852aa7c3a4e5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125012 Jan 17 02:52:57.621624 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 749/1474] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:52:57.685265 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:57.693130 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-b86a577b-7004-444c-a680-e0517244364f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.199898 Jan 17 02:52:57.693785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 726/1475] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:57 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:58.716170 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:58.717338 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:58.726409 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:58.726860 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:58.727636 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:58.728088 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:58.876021 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:52:58.885808 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e350f09a-1fd9-482f-b582-bb78fbd925b8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.177186 Jan 17 02:52:58.886399 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 750/1476] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:58 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:52:59.904906 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:52:59.905807 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:52:59.914142 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:59.914707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:52:59.915668 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:52:59.916261 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:00.050130 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:00.058847 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-8b8328fa-4901-4aa1-8295-787599fca525 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.158926 Jan 17 02:53:00.059448 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 727/1477] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:52:59 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:01.079763 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:01.080784 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:01.091521 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:01.092340 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:01.093611 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:01.094329 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:01.239138 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:01.248308 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-f78a3549-a235-48a2-9874-3b31aa427f3b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.174368 Jan 17 02:53:01.249139 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 751/1478] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:01 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:02.269581 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:02.270556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:02.277662 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:02.278077 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:02.278869 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:02.279296 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:02.419190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:02.430694 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-809b6128-fa0a-4692-b885-3de5125c4dc6 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.167287 Jan 17 02:53:02.431602 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 728/1479] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:02 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:03.448903 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:03.449499 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:03.456628 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:03.457073 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:03.457850 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:03.458278 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:03.595227 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:03.607119 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fa01c16e-d3ee-4818-9672-3514484bfc2f tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.161702 Jan 17 02:53:03.607931 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 752/1480] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:03 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:04.630908 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:04.631857 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:04.639628 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:04.640105 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:04.641328 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:04.641823 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:04.783610 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:04.791092 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-847d4122-fd46-4a21-848e-7182e0475429 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.166246 Jan 17 02:53:04.791647 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 729/1481] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:04 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:05.811955 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:05.813024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:05.823691 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:05.824496 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:05.825768 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:05.826478 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:05.970038 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:05.979900 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-08623028-0626-478d-bb87-34f914e1b97e tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.173961 Jan 17 02:53:05.980666 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 753/1482] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:05 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:07.000734 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:07.001781 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:07.011194 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:07.011581 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:07.012404 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:07.012840 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:07.155582 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:07.163140 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-ed7d71d8-58fb-4fc2-a86e-379fae46ca7b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.168641 Jan 17 02:53:07.163910 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 730/1483] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:06 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:08.184240 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:08.185234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:08.195794 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:08.196583 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:08.197845 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:08.198564 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:08.345920 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:08.353795 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-72ed319d-63d9-4342-ba8c-0c5637b4dd17 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.175763 Jan 17 02:53:08.354364 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 754/1484] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:08 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:08.760152 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-6e6ab68b-b142-45ad-9c24-a88c547ca5f7 req-61f8f897-c3fc-4cb5-9230-942433032cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa23975-4d62-4b66-9863-156b9e5f8d29", "name": "network-vif-plugged", "status": "completed", "tag": "ae80d547-f803-4ef6-9d6d-dda79cbe5722"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:53:08.761811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:53:08.761811 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:53:08.769243 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-6e6ab68b-b142-45ad-9c24-a88c547ca5f7 req-61f8f897-c3fc-4cb5-9230-942433032cb2 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:08.769760 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-6e6ab68b-b142-45ad-9c24-a88c547ca5f7 req-61f8f897-c3fc-4cb5-9230-942433032cb2 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:08.781377 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-6e6ab68b-b142-45ad-9c24-a88c547ca5f7 req-61f8f897-c3fc-4cb5-9230-942433032cb2 service nova] Creating event network-vif-plugged:ae80d547-f803-4ef6-9d6d-dda79cbe5722 for instance 2fa23975-4d62-4b66-9863-156b9e5f8d29 on hv-cinder-82160 Jan 17 02:53:08.784988 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: ERROR oslo.messaging._drivers.impl_rabbit [req-6e6ab68b-b142-45ad-9c24-a88c547ca5f7 req-61f8f897-c3fc-4cb5-9230-942433032cb2 service nova] [f4afc162-704b-4e45-9c37-6e31d5b802b3] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 02:53:09.374586 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:09.375619 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:09.385372 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:09.385818 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:09.386617 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:09.387047 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:09.517187 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:09.525356 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2bdf8486-31f5-4a9f-9575-3aa9a42c84f8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.157105 Jan 17 02:53:09.525933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 755/1485] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:09 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:09.794639 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [req-6e6ab68b-b142-45ad-9c24-a88c547ca5f7 req-61f8f897-c3fc-4cb5-9230-942433032cb2 service nova] [f4afc162-704b-4e45-9c37-6e31d5b802b3] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 53190. Jan 17 02:53:09.798103 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-6e6ab68b-b142-45ad-9c24-a88c547ca5f7 req-61f8f897-c3fc-4cb5-9230-942433032cb2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.092986 Jan 17 02:53:09.798703 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 731/1486] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:53:10.546317 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:10.546924 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:10.553881 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:10.554331 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:10.555112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:10.555544 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:10.701964 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:10.712251 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-41b056fb-06eb-4166-aefd-1ebc18785910 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1265 microversion: 2.1 time: 0.169340 Jan 17 02:53:10.713024 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 756/1487] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:10 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:11.735407 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:11.736096 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:11.742790 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:11.743282 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:11.744088 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:11.744547 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:11.881400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:11.889225 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-4235a686-5089-4320-8d04-980c79017310 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1452 microversion: 2.1 time: 0.158377 Jan 17 02:53:11.889789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 732/1488] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:11 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:11.906462 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:53:11.907147 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:53:11.914689 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:11.915332 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:11.916101 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:11.916555 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:12.060450 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:53:12.068528 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-a77d69c9-3123-40f8-8fbf-7ee9d65eab52 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1452 microversion: 2.1 time: 0.166149 Jan 17 02:53:12.069337 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 757/1489] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:53:11 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:53:14.111658 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-df9397e4-2c05-464a-bea4-4a82bd336c11 req-91d0f52a-ca91-4179-90a4-41fe8a6631f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa23975-4d62-4b66-9863-156b9e5f8d29", "tag": "ae80d547-f803-4ef6-9d6d-dda79cbe5722"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:53:14.113190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:53:14.113190 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:53:14.120352 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-df9397e4-2c05-464a-bea4-4a82bd336c11 req-91d0f52a-ca91-4179-90a4-41fe8a6631f2 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:53:14.120762 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-df9397e4-2c05-464a-bea4-4a82bd336c11 req-91d0f52a-ca91-4179-90a4-41fe8a6631f2 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:53:14.131306 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-df9397e4-2c05-464a-bea4-4a82bd336c11 req-91d0f52a-ca91-4179-90a4-41fe8a6631f2 service nova] Creating event network-changed:ae80d547-f803-4ef6-9d6d-dda79cbe5722 for instance 2fa23975-4d62-4b66-9863-156b9e5f8d29 on hv-cinder-82160 Jan 17 02:53:14.136799 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-df9397e4-2c05-464a-bea4-4a82bd336c11 req-91d0f52a-ca91-4179-90a4-41fe8a6631f2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083169 Jan 17 02:53:14.137556 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 733/1490] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:53:38.437534 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:53:38.438439 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 02:53:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:54:35.725475 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:54:35.726424 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:55:14.903693 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb54f0bf-7465-4ec0-997c-88e8abc97e4e] AMQP server on 10.222.0.24:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 17 02:55:14.904536 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:14.905027 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:14.908790 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-e2504b02-f63a-42c8-8b27-455ed2329a3d req-412bfa85-346e-4205-9353-82bae442ba8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa23975-4d62-4b66-9863-156b9e5f8d29", "tag": "ae80d547-f803-4ef6-9d6d-dda79cbe5722"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:55:14.911010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:55:14.911010 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:55:14.911822 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:14.912321 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:14.913108 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:14.913530 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:14.918705 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e2504b02-f63a-42c8-8b27-455ed2329a3d req-412bfa85-346e-4205-9353-82bae442ba8b service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:14.919228 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-e2504b02-f63a-42c8-8b27-455ed2329a3d req-412bfa85-346e-4205-9353-82bae442ba8b service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:14.932016 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-e2504b02-f63a-42c8-8b27-455ed2329a3d req-412bfa85-346e-4205-9353-82bae442ba8b service nova] Creating event network-changed:ae80d547-f803-4ef6-9d6d-dda79cbe5722 for instance 2fa23975-4d62-4b66-9863-156b9e5f8d29 on hv-cinder-82160 Jan 17 02:55:14.937575 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-e2504b02-f63a-42c8-8b27-455ed2329a3d req-412bfa85-346e-4205-9353-82bae442ba8b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035689 Jan 17 02:55:14.938170 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 734/1491] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:55:14.942011 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:55:15.028451 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-49c99cbb-cb2a-48dc-abd9-b9b0a0d02657 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 204 len: 0 microversion: 2.1 time: 0.127953 Jan 17 02:55:15.029118 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 758/1492] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:55:14 2022] DELETE /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:55:15.037714 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:15.038396 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:15.044681 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:15.045351 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:15.046176 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:15.046608 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:15.185796 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:55:15.193156 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-bfd17653-0ffb-4f74-a4d8-3826a767dfc0 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1577 microversion: 2.1 time: 0.159475 Jan 17 02:55:15.193720 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 735/1493] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:15 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:55:16.211440 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:16.212150 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:16.218966 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:16.219421 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:16.220238 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:16.220676 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:16.369790 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:55:16.377775 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-fedbc4c9-9a75-4cf1-8121-240f03c9f372 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1458 microversion: 2.1 time: 0.170573 Jan 17 02:55:16.378336 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 759/1494] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:16 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1458 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:55:17.374712 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-53bb4b79-142c-413f-8ae0-8f10e3ec3c93 req-7ad440a7-5166-4ef4-8894-525242de32d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa23975-4d62-4b66-9863-156b9e5f8d29", "name": "network-vif-deleted", "tag": "ae80d547-f803-4ef6-9d6d-dda79cbe5722"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:55:17.376234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:55:17.376234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:55:17.384799 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-53bb4b79-142c-413f-8ae0-8f10e3ec3c93 req-7ad440a7-5166-4ef4-8894-525242de32d1 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:17.385400 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-53bb4b79-142c-413f-8ae0-8f10e3ec3c93 req-7ad440a7-5166-4ef4-8894-525242de32d1 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:17.394881 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:17.395838 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:17.400707 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb54f0bf-7465-4ec0-997c-88e8abc97e4e] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 53258. Jan 17 02:55:17.402404 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:17.402994 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:17.403640 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:17.403776 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-53bb4b79-142c-413f-8ae0-8f10e3ec3c93 req-7ad440a7-5166-4ef4-8894-525242de32d1 service nova] Creating event network-vif-deleted:ae80d547-f803-4ef6-9d6d-dda79cbe5722 for instance 2fa23975-4d62-4b66-9863-156b9e5f8d29 on hv-cinder-82160 Jan 17 02:55:17.404088 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:17.409728 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-53bb4b79-142c-413f-8ae0-8f10e3ec3c93 req-7ad440a7-5166-4ef4-8894-525242de32d1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038483 Jan 17 02:55:17.410672 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 736/1495] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:55:17.466357 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:55:17.473798 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-e1f72c2c-92f5-4866-98d0-a80b126e9d18 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 200 len: 1224 microversion: 2.1 time: 0.082629 Jan 17 02:55:17.474364 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 760/1496] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:17 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:55:18.495938 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:18.496669 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 2fa23975-4d62-4b66-9863-156b9e5f8d29] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:18.505269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:18.505837 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:18.506815 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:18.507370 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:18.524785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] HTTP exception thrown: Instance 2fa23975-4d62-4b66-9863-156b9e5f8d29 could not be found. Jan 17 02:55:18.525512 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Returning 404 to user: Instance 2fa23975-4d62-4b66-9863-156b9e5f8d29 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:55:18.526560 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-058ee8e7-f908-4c79-ab04-441dcc750924 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29" status: 404 len: 111 microversion: 2.1 time: 0.037471 Jan 17 02:55:18.527168 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 737/1497] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:18 2022] GET /compute/v2.1/servers/2fa23975-4d62-4b66-9863-156b9e5f8d29 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:55:21.651866 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:21.652431 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:21.653909 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-286fe514-fb61-4557-95c4-3fb8e66be761 req-d493e76a-2b16-48c6-ab05-3bd2f785e494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8101de1a-f163-4b09-affe-30cee1520021", "tag": "7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:55:21.655480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:55:21.655480 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:55:21.659438 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:21.660007 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:21.661067 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:21.661505 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:21.664234 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-286fe514-fb61-4557-95c4-3fb8e66be761 req-d493e76a-2b16-48c6-ab05-3bd2f785e494 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:21.664688 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-286fe514-fb61-4557-95c4-3fb8e66be761 req-d493e76a-2b16-48c6-ab05-3bd2f785e494 service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:21.675881 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-286fe514-fb61-4557-95c4-3fb8e66be761 req-d493e76a-2b16-48c6-ab05-3bd2f785e494 service nova] Creating event network-changed:7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa for instance 8101de1a-f163-4b09-affe-30cee1520021 on hv-cinder-82160 Jan 17 02:55:21.681107 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-286fe514-fb61-4557-95c4-3fb8e66be761 req-d493e76a-2b16-48c6-ab05-3bd2f785e494 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030977 Jan 17 02:55:21.681702 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 738/1498] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:55:21.688503 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Going to try to terminate instance {{(pid=122781) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 02:55:21.780086 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-47ef414c-2d74-4074-b7b9-c5b1f1a13e41 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 204 len: 0 microversion: 2.1 time: 0.131792 Jan 17 02:55:21.780714 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 761/1499] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:55:21 2022] DELETE /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 02:55:21.789362 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:21.790088 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:21.797195 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:21.797789 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:21.799671 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:21.800238 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:21.949919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.policy [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122782) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:55:21.959074 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-d5793a0b-7138-447e-a605-ec63dc6502d5 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1575 microversion: 2.1 time: 0.173759 Jan 17 02:55:21.959943 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 739/1500] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:21 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:55:22.981600 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:22.982729 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:22.993320 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:22.994112 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:22.995384 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:22.996130 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:23.136787 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:55:23.145234 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-ca5087aa-323e-4306-a65f-28e43491c46b tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1458 microversion: 2.1 time: 0.170538 Jan 17 02:55:23.145803 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 762/1501] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:22 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1458 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:55:24.025589 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [req-9585961a-1092-4f8f-845d-f340dd3fba5b req-fdcfe00a-51df-4207-860c-f250ab3c642a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8101de1a-f163-4b09-affe-30cee1520021", "name": "network-vif-deleted", "tag": "7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa"}]} {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 02:55:24.027153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 02:55:24.027153 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: warnings.warn(msg) Jan 17 02:55:24.034785 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-9585961a-1092-4f8f-845d-f340dd3fba5b req-fdcfe00a-51df-4207-860c-f250ab3c642a service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:24.035224 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [req-9585961a-1092-4f8f-845d-f340dd3fba5b req-fdcfe00a-51df-4207-860c-f250ab3c642a service nova] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:24.046379 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.compute.server_external_events [req-9585961a-1092-4f8f-845d-f340dd3fba5b req-fdcfe00a-51df-4207-860c-f250ab3c642a service nova] Creating event network-vif-deleted:7ecd8e7b-2649-4d5f-aee2-ae5d6c6051aa for instance 8101de1a-f163-4b09-affe-30cee1520021 on hv-cinder-82160 Jan 17 02:55:24.050985 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [req-9585961a-1092-4f8f-845d-f340dd3fba5b req-fdcfe00a-51df-4207-860c-f250ab3c642a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029022 Jan 17 02:55:24.051779 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 740/1502] 10.222.0.24 () {64 vars in 1317 bytes} [Mon Jan 17 02:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 02:55:24.162332 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:24.162977 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:24.169993 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:24.170443 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:24.171214 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:24.171644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:24.229886 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.policy [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8898f4f5a045c0b1309bfc171c7d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5fffc31fb74051bb8478ab98082f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122781) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 02:55:24.237882 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2a7117b5-65b9-433d-8826-2b67baa8b897 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 200 len: 1223 microversion: 2.1 time: 0.079186 Jan 17 02:55:24.238398 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 763/1503] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:24 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 02:55:25.261761 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:25.262896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 8101de1a-f163-4b09-affe-30cee1520021] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:25.278135 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:25.278588 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:25.279378 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:25.279813 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:25.293165 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] HTTP exception thrown: Instance 8101de1a-f163-4b09-affe-30cee1520021 could not be found. Jan 17 02:55:25.293753 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Returning 404 to user: Instance 8101de1a-f163-4b09-affe-30cee1520021 could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:55:25.294572 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-08e4d446-5b2b-4194-bb43-a9cb807702d8 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021" status: 404 len: 111 microversion: 2.1 time: 0.040434 Jan 17 02:55:25.295082 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 741/1504] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:25 2022] GET /compute/v2.1/servers/8101de1a-f163-4b09-affe-30cee1520021 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:55:25.762391 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:25.763002 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.compute.api [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122781) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:25.770303 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:25.770687 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:25.771508 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:25.771945 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG oslo_concurrency.lockutils [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:25.785933 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.wsgi [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] HTTP exception thrown: Instance 54f51f9f-61be-4b32-b9e7-1d49673a021e could not be found. Jan 17 02:55:25.786517 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Returning 404 to user: Instance 54f51f9f-61be-4b32-b9e7-1d49673a021e could not be found. {{(pid=122781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:55:25.787341 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-379c07ca-a8ef-4a20-b08d-7c91f6a14695 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "DELETE /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 404 len: 111 microversion: 2.1 time: 0.028780 Jan 17 02:55:25.787880 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 764/1505] 10.222.0.24 () {58 vars in 1238 bytes} [Mon Jan 17 02:55:25 2022] DELETE /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:55:25.796340 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '>' {{(pid=122782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:25.796949 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.compute.api [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] [instance: 54f51f9f-61be-4b32-b9e7-1d49673a021e] Fetching instance by UUID {{(pid=122782) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 02:55:25.803443 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:25.803919 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:25.804718 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 02:55:25.805155 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG oslo_concurrency.lockutils [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Lock "5c3aa57c-ff8a-4b88-aed5-f2a3f651e1a7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 02:55:25.818318 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.wsgi [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] HTTP exception thrown: Instance 54f51f9f-61be-4b32-b9e7-1d49673a021e could not be found. Jan 17 02:55:25.818896 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: DEBUG nova.api.openstack.wsgi [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Returning 404 to user: Instance 54f51f9f-61be-4b32-b9e7-1d49673a021e could not be found. {{(pid=122782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 02:55:25.819714 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO nova.api.openstack.requestlog [None req-c7e58f76-e21a-422c-bb83-7c2e226b6643 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e" status: 404 len: 111 microversion: 2.1 time: 0.027429 Jan 17 02:55:25.820269 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: [pid: 122782|app: 0|req: 742/1506] 10.222.0.24 () {58 vars in 1235 bytes} [Mon Jan 17 02:55:25 2022] GET /compute/v2.1/servers/54f51f9f-61be-4b32-b9e7-1d49673a021e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 02:55:27.122644 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: DEBUG nova.api.openstack.wsgi [None req-2015fbfa-1626-45e3-8abf-866499f33774 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] Calling method '.version_select at 0x7f074e80b280>' {{(pid=122781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 02:55:27.158668 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO nova.api.openstack.requestlog [None req-2015fbfa-1626-45e3-8abf-866499f33774 tempest-TestVolumeBootPattern-2075548085 tempest-TestVolumeBootPattern-2075548085-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-71927295" status: 202 len: 0 microversion: 2.1 time: 0.039763 Jan 17 02:55:27.159262 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: [pid: 122781|app: 0|req: 765/1507] 10.222.0.24 () {58 vars in 1256 bytes} [Mon Jan 17 02:55:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-71927295 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 02:56:14.709346 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:56:14.710315 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:57:51.909791 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:57:51.910815 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 02:57:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:57:55.739123 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:57:55.740020 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:58:11.479451 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:58:11.480611 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:58:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:58:23.086437 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:58:23.087605 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 02:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:58:38.453076 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:58:38.454103 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 02:58:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 02:59:34.724958 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 02:59:34.725899 dv-cinder-821602-13-iscsi devstack@n-api.service[122782]: Mon Jan 17 02:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 03:01:11.923716 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 03:01:11.924179 dv-cinder-821602-13-iscsi devstack@n-api.service[122781]: Mon Jan 17 03:01:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!